-- Logs begin at Thu 2022-06-23 10:50:09 UTC, end at Thu 2022-06-23 11:49:15 UTC. -- Jun 23 11:17:29.760098 dv-cinder-820994-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 11:17:29 2022] *** Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: nodename: dv-cinder-820994-2-smb Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: machine: x86_64 Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: clock source: unix Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: pcre jit disabled Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: detected number of CPU cores: 4 Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: current working directory: / Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: detected binary path: /usr/bin/uwsgi-core Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: your processes number limit is 47680 Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: your memory page size is 4096 bytes Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: detected max file descriptor number: 2048 Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: lock engine: pthread robust mutexes Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: thunder lock: enabled Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 11:17:29.775952 dv-cinder-820994-2-smb devstack@keystone.service[80120]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 11:17:29.814051 dv-cinder-820994-2-smb devstack@keystone.service[80120]: Python main interpreter initialized at 0x55bbbf17e9c0 Jun 23 11:17:29.814051 dv-cinder-820994-2-smb devstack@keystone.service[80120]: python threads support enabled Jun 23 11:17:29.814051 dv-cinder-820994-2-smb devstack@keystone.service[80120]: your server socket listen backlog is limited to 100 connections Jun 23 11:17:29.814051 dv-cinder-820994-2-smb devstack@keystone.service[80120]: your mercy for graceful operations on workers is 90 seconds Jun 23 11:17:29.814381 dv-cinder-820994-2-smb devstack@keystone.service[80120]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 11:17:29.814449 dv-cinder-820994-2-smb devstack@keystone.service[80120]: *** Operational MODE: preforking *** Jun 23 11:17:29.814734 dv-cinder-820994-2-smb devstack@keystone.service[80120]: *** uWSGI is running in multiple interpreter mode *** Jun 23 11:17:29.814734 dv-cinder-820994-2-smb devstack@keystone.service[80120]: spawned uWSGI master process (pid: 80120) Jun 23 11:17:29.814930 dv-cinder-820994-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 11:17:29.815987 dv-cinder-820994-2-smb devstack@keystone.service[80120]: spawned uWSGI worker 1 (pid: 80130, cores: 1) Jun 23 11:17:29.815987 dv-cinder-820994-2-smb devstack@keystone.service[80120]: spawned uWSGI worker 2 (pid: 80131, cores: 1) Jun 23 11:17:29.815987 dv-cinder-820994-2-smb devstack@keystone.service[80120]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 11:17:35.166751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:17:35.166751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: from cryptography.utils import int_from_bytes Jun 23 11:17:35.167528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:17:35.167528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: from cryptography.utils import int_from_bytes Jun 23 11:17:35.169840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:17:35.169840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: from cryptography.utils import int_from_bytes Jun 23 11:17:35.170355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:17:35.170355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: from cryptography.utils import int_from_bytes Jun 23 11:17:35.215784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:17:35.215949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:17:35.216158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] command line args: [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:17:35.216425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:17:35.216561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ================================================================================ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:17:35.216880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] admin_token = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.217127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config_dir = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.217317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:17:35.217439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.217439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config_source = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.217585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:17:35.217650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] debug = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.217715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] command line args: [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:17:35.217861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.218079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:17:35.218079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ================================================================================ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:17:35.218496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.218655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.218916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] admin_token = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config_dir = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_config_append = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config_source = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.219995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] debug = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_dir = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.220930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_config_append = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221596 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_dir = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.221936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.222905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223826 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.223976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.224118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.224238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] publish_errors = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.224356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.224467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.224591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.224708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.224944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] standard_threads = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.225928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] publish_errors = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_journal = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_json = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_stderr = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.226990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.227108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_syslog = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.227218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.227329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.227438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] standard_threads = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.227554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.227670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.227789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.227901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.227901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.228310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.228432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_journal = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.228550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.228676 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_json = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.228805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.228917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_stderr = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.229039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.229157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_syslog = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.229275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.229398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:17:35.229509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.229626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.229737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.229847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.229957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.230885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.231788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.232903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.233923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234721 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.234951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.235945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.236887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237116 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.237992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238337 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.238904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.239910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.240967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.241988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.242992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.243912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.244976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.245989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246201 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.246974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.247892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.248889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.249924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.250936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.external = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.251922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.password = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.252891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.token = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.external = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.253832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.password = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.token = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.254936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255721 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.255953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.256889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.257932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.258950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.259892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.260123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.260289 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.260413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.260529 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.260642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.260792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.260910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.261954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.262958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.263988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.264958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265415 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.265988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.266889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.267908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.268951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.269948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.270978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.271984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.272916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.273945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.274957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.275887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.276910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.277943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.278951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.279970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.280920 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281031 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.281935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.282948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.283846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.284953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.285965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.286986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.287993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.288941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.289961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.290080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.290193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.290304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.290417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.290527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.290664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.290923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.291393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.291563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.291813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.291981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.292950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.293968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294080 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.294991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.295894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.296997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.297916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.298960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299803 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.299915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.300896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.301024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:17:35.301139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.301139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.301350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.301591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.301834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.302088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.302292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.302564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.302769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.303036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.303281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:17:35.303461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:17:35.331681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.331838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.332047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.333299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.333534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.333762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.340580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.342375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.368456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.368679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.369971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.370199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.514708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.514926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.563173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.563382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.563470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.563730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.627826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.628977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.629179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.654166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.654348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.654602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.654727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.654864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.654945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655502 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.655952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.666724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.667058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.679513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.679745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.679981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.680914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.681004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.681080 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.681284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 11:17:35.698825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.699033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:17:35.699357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.699449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.699551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:17:35.699637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:17:35.699825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.699909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.700078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 11:17:35.700161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.700328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.700411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.700579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.700662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.700848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.701109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.711411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.711671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.711833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.711946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.712088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.712207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.712389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.712753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.720477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.721136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.723755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.724034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.724310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.724432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.724597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.724681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.724874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.724999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.725995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.726155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.726280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.726392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.726480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.726725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.726988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.752876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.753418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.754476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.754743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.755023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.755300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.759995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.760379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.760521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.760659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.760954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.761236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.767861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.768140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.768465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.768757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.772606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.772908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.773184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.773327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.773465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.773547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.773690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.773778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.773990 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.774115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.774234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.774317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.774502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.774640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.774776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.775042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.793187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.793458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.793911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.794188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.798083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.798966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.801716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.802109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.802626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.803023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.807148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.808155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.810764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.811769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.814432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.814697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.815009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.815297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.815439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.815577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.815734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.815858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.815994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.816292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.816568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.816864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.835103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.835380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.835643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.835908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.836391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.836682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.836970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.837240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.843823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.845118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.845543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.845816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.846827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.847101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.849046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.849339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.849631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.849928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.850247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.850390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.850611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.850884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.851164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.851405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.863615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.863899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.864165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.864441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.864577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.864901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.865179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.865455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.866018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.866309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.866618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.866980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.867273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.867569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.884476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.885573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.887758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.888884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.891082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.892205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.892820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.893946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.894440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.894720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.895006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.895580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.895855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.896136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.902561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.903610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.904160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.905249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.907390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.907675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.908058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.908333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.908475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.908754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.909131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.909408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.917664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.917953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.918234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.918545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.918831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.919108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.926087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.926360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.926636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.926903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.927028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 11:17:35.927164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.927259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.927503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.927635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.927821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.927948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.928090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.928226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.928404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.928526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.928676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.928798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.928966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929077 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.929963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.931514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.931794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 11:17:35.968135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbbf17e9c0 pid: 80130 (default app) Jun 23 11:17:35.969929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bbbf17e9c0 pid: 80131 (default app) Jun 23 11:17:35.971601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbee2a1-6a5a-41ba-b51d-95ec08100df1 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.971894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbee2a1-6a5a-41ba-b51d-95ec08100df1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.972169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbee2a1-6a5a-41ba-b51d-95ec08100df1 None None] PATH_INFO: `/v3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.976391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Thu Jun 23 11:17:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:43.744075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db2376-c1a5-4b75-a8f9-9222054164f6 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:43.744757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db2376-c1a5-4b75-a8f9-9222054164f6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:43.744757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db2376-c1a5-4b75-a8f9-9222054164f6 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:43.753220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:43 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:43.758957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:43.759408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:43.759498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:43.836008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: INFO dbcounter [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] Registered counter for database keystone Jun 23 11:17:43.860681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG oslo_db.sqlalchemy.engines [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:17:43.871568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writer thread running {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:17:44.051667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG passlib.handlers.bcrypt [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80130) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 11:17:44.052000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG passlib.handlers.bcrypt [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80130) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 11:17:44.107951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:44.109336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:44.248860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 11:17:44.410741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db2376-c1a5-4b75-a8f9-9222054164f6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:44.488195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: INFO dbcounter [None req-64db2376-c1a5-4b75-a8f9-9222054164f6 None None] Registered counter for database keystone Jun 23 11:17:44.509065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG oslo_db.sqlalchemy.engines [None req-64db2376-c1a5-4b75-a8f9-9222054164f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:17:44.519586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writer thread running {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:17:44.641083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db2376-c1a5-4b75-a8f9-9222054164f6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:44.646462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce0b9-109b-4ca0-91e0-ef0efaa965a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:44.647128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce0b9-109b-4ca0-91e0-ef0efaa965a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:44.647411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce0b9-109b-4ca0-91e0-ef0efaa965a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:44.647664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce0b9-109b-4ca0-91e0-ef0efaa965a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:44.656548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ce0b9-109b-4ca0-91e0-ef0efaa965a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:44.708102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a6ce0b9-109b-4ca0-91e0-ef0efaa965a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 11:17:44.708438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ce0b9-109b-4ca0-91e0-ef0efaa965a7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:44.718938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Thu Jun 23 11:17:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:17:44.725976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:44.747203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ba84-c75d-4979-a979-808a1d763ff2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:44.753014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b46ef3-9631-4f33-8a0d-4b619b447997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:44.754161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46ef3-9631-4f33-8a0d-4b619b447997 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:44.754454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46ef3-9631-4f33-8a0d-4b619b447997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:44.754729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46ef3-9631-4f33-8a0d-4b619b447997 admin admin] PATH_INFO: `/v3/projects/e7142c8080614c18a4273bc9286ea762` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:44.758954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b46ef3-9631-4f33-8a0d-4b619b447997 admin admin] RBAC: Authorizing `identity:get_project(project_id=e7142c8080614c18a4273bc9286ea762)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:44.820168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37b46ef3-9631-4f33-8a0d-4b619b447997 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 11:17:44.820877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b46ef3-9631-4f33-8a0d-4b619b447997 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:44.826238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Thu Jun 23 11:17:44 2022] GET /identity/v3/projects/e7142c8080614c18a4273bc9286ea762 => generated 344 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:46.894032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23853-26bb-4bf5-8cb5-165040ebf86a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:46.894913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23853-26bb-4bf5-8cb5-165040ebf86a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:46.894913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f23853-26bb-4bf5-8cb5-165040ebf86a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:46.901115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:46.907635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84b5b-7229-4621-bf42-e7ad050147dc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:46.908136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84b5b-7229-4621-bf42-e7ad050147dc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:46.908228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84b5b-7229-4621-bf42-e7ad050147dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:46.936391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-46f84b5b-7229-4621-bf42-e7ad050147dc None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:46.938046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-46f84b5b-7229-4621-bf42-e7ad050147dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:46.955238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 11:17:46.985003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f23853-26bb-4bf5-8cb5-165040ebf86a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:47.003773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f23853-26bb-4bf5-8cb5-165040ebf86a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:47.010082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a765db4-1a3f-44fb-b66e-4c1b21ef3ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:47.010737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a765db4-1a3f-44fb-b66e-4c1b21ef3ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:47.011027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a765db4-1a3f-44fb-b66e-4c1b21ef3ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:47.011309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a765db4-1a3f-44fb-b66e-4c1b21ef3ed0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:47.020255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a765db4-1a3f-44fb-b66e-4c1b21ef3ed0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:47.022115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a765db4-1a3f-44fb-b66e-4c1b21ef3ed0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:47.032232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Thu Jun 23 11:17:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:17:47.041324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84b5b-7229-4621-bf42-e7ad050147dc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:47.053622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84b5b-7229-4621-bf42-e7ad050147dc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:47.059559 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554e281-cc3c-4da3-88d7-6eff53e0ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:47.060477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554e281-cc3c-4da3-88d7-6eff53e0ae79 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:47.060760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554e281-cc3c-4da3-88d7-6eff53e0ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:47.061038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554e281-cc3c-4da3-88d7-6eff53e0ae79 admin admin] PATH_INFO: `/v3/users/91e4179db7ac4303a76052708306002a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:47.062583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554e281-cc3c-4da3-88d7-6eff53e0ae79 admin admin] RBAC: Authorizing `identity:get_user(user_id=91e4179db7ac4303a76052708306002a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:47.064437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554e281-cc3c-4da3-88d7-6eff53e0ae79 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:47.066107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Thu Jun 23 11:17:47 2022] GET /identity/v3/users/91e4179db7ac4303a76052708306002a => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:49.164251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27259fc-2c18-4149-8c7b-e90f1f234b2d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.164846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27259fc-2c18-4149-8c7b-e90f1f234b2d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.164846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27259fc-2c18-4149-8c7b-e90f1f234b2d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.166278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:49.171678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8110f42-efd5-403a-afe3-a312a0daec04 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.172140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8110f42-efd5-403a-afe3-a312a0daec04 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.172224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8110f42-efd5-403a-afe3-a312a0daec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.186468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92290a29-557a-4d0e-b010-548e5711eb73 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.186730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92290a29-557a-4d0e-b010-548e5711eb73 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.187120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92290a29-557a-4d0e-b010-548e5711eb73 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.188460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 6/11] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:17:49.190547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b8110f42-efd5-403a-afe3-a312a0daec04 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:49.191732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b8110f42-efd5-403a-afe3-a312a0daec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:49.193775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.194063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.194341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.233429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG passlib.handlers.bcrypt [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80131) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 11:17:49.233845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG passlib.handlers.bcrypt [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80131) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 11:17:49.275594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:49.279134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:49.280750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:49.299474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8110f42-efd5-403a-afe3-a312a0daec04 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.324836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:49.381729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:17:49.405307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.405501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8110f42-efd5-403a-afe3-a312a0daec04 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:49.439691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:49.440510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.440829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.441125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.453128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:17:49.464359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:17:49.465314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:17:49.466137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 7/14] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:17:49.471499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.510661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648775-aa14-4a10-82f4-52ee8dcdd258 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:49.512940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:49.547835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:49.548765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.549054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.549328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.556269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:49.576270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864ae75-7cc1-4092-856a-d6f07e8f8931 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:49.609240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:49.609980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.610260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.610531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.611324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:49.611632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:49.613119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:49.617230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:49.618936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:49.625821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 8/15] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:49.632481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.718826 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 8/16] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:17:49.724910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.728205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:49.734183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222f2ab-01d3-4a2a-9e45-ada6be97c357 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:49.767985 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:49.769051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.769422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.769707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] PATH_INFO: `/v3/users/91e4179db7ac4303a76052708306002a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.770942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=91e4179db7ac4303a76052708306002a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:49.772448 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:49.774137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 9/17] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/users/91e4179db7ac4303a76052708306002a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:49.779757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.794054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:49.825837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614da8b-8fac-4a6f-91a0-41d0373b56f5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:49.858519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:49.859261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.859531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.859808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.877321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fc169-20f7-43e6-8fde-9dd0b9107aa2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:49.878419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:49.879897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:17:49.900825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:17:49.901799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:17:49.902776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:17:49.902776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:17:49.902776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:17:49.902776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:17:49.902776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 9/18] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:17:49.907837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.913795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:49.914606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:49.914890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:49.915195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:49.916422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:49.917943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:49.919588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 10/19] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:49.925473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:49.966030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:50.004829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:50.011323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d364b51-29f3-4642-810c-a8bc8500a894 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:50.023705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4062b-6730-46af-8e60-ba3c88aea3ad None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:50.049074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37185642-64bb-4d2e-a31b-126167d4d055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:50.049738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185642-64bb-4d2e-a31b-126167d4d055 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:50.050019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185642-64bb-4d2e-a31b-126167d4d055 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:50.050296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37185642-64bb-4d2e-a31b-126167d4d055 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:50.051030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37185642-64bb-4d2e-a31b-126167d4d055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:50.051327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37185642-64bb-4d2e-a31b-126167d4d055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:50.052744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37185642-64bb-4d2e-a31b-126167d4d055 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:50.061678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b2ac4-d5f6-4409-994e-8d5165af33a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:50.062344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b2ac4-d5f6-4409-994e-8d5165af33a3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:50.062627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b2ac4-d5f6-4409-994e-8d5165af33a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:50.062903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b2ac4-d5f6-4409-994e-8d5165af33a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:50.063741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b2ac4-d5f6-4409-994e-8d5165af33a3 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.domain.id=default, user.id=91e4179db7ac4303a76052708306002a) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:50.064052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b2ac4-d5f6-4409-994e-8d5165af33a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:50.065518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b2ac4-d5f6-4409-994e-8d5165af33a3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:50.070725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 10/20] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:50.072572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 11/21] 10.222.0.66 () {56 vars in 1322 bytes} [Thu Jun 23 11:17:49 2022] GET /identity/v3/role_assignments?user.id=91e4179db7ac4303a76052708306002a&scope.domain.id=default&role.id=2072cf36ca344da697b097313f411f3b => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:52.608753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0773d-f0b1-4589-95de-5ce26bd9a438 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.608753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0773d-f0b1-4589-95de-5ce26bd9a438 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.608753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0773d-f0b1-4589-95de-5ce26bd9a438 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.610168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 11/22] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:52.622965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc655e-cb50-45c5-bf82-2b7fc4e666af None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.623907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc655e-cb50-45c5-bf82-2b7fc4e666af None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.624402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc655e-cb50-45c5-bf82-2b7fc4e666af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.646648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0afc655e-cb50-45c5-bf82-2b7fc4e666af None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:52.648177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0afc655e-cb50-45c5-bf82-2b7fc4e666af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:52.730626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:52.768083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0773d-f0b1-4589-95de-5ce26bd9a438 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:52.895522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0773d-f0b1-4589-95de-5ce26bd9a438 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:52.920351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:52.932499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb44c-817f-4c8e-890b-5d71058b705a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.933088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb44c-817f-4c8e-890b-5d71058b705a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.933562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb44c-817f-4c8e-890b-5d71058b705a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.935155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:52.940748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06365e95-6b59-472a-8f48-ee2963bb0677 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.941253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06365e95-6b59-472a-8f48-ee2963bb0677 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.941742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06365e95-6b59-472a-8f48-ee2963bb0677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.966518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:52.967190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.967471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.967741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.973728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-06365e95-6b59-472a-8f48-ee2963bb0677 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:52.974939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-06365e95-6b59-472a-8f48-ee2963bb0677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:52.983430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:52.984975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:17:53.014817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:17:53.015663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:17:53.016943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:17:53.016943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:17:53.016943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:17:53.016943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:17:53.016943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 12/25] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:17:53.021839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.139241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 14/26] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:17:53.140637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ef02-63b6-4f47-a660-d5c4a0a8765a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.140950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ef02-63b6-4f47-a660-d5c4a0a8765a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.141227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ef02-63b6-4f47-a660-d5c4a0a8765a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.142504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 15/27] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:53.152857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370146b7-578e-41ef-8799-21bc71fd55a9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.153330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370146b7-578e-41ef-8799-21bc71fd55a9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.153745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370146b7-578e-41ef-8799-21bc71fd55a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.157461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eef028-314a-48f6-b01b-a217d5a59325 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.165547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:53.186511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-370146b7-578e-41ef-8799-21bc71fd55a9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:53.187910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-370146b7-578e-41ef-8799-21bc71fd55a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:53.196941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.198019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.198488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.198925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.199799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:53.200244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.202341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.217098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 13/28] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:53.218619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.263752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:53.294393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 16/29] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:53.295224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370146b7-578e-41ef-8799-21bc71fd55a9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.351000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f103fd-4bf6-482f-8bf5-62e6db3bfe18 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.389855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea3c5b-f283-45c6-928a-000e4038ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.391094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3c5b-f283-45c6-928a-000e4038ce16 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.391611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3c5b-f283-45c6-928a-000e4038ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.392091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3c5b-f283-45c6-928a-000e4038ce16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.400290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370146b7-578e-41ef-8799-21bc71fd55a9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.405491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea3c5b-f283-45c6-928a-000e4038ce16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-69ea3c5b-f283-45c6-928a-000e4038ce16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:17:53.415283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:17:53.416709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:17:53.417469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:17:53.419982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 14/30] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:17:53.421523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d275bba-bb06-4ce3-bf92-ff897925761d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.421991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d275bba-bb06-4ce3-bf92-ff897925761d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.422426 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d275bba-bb06-4ce3-bf92-ff897925761d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.423954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 15/31] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:53.424855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d275bba-bb06-4ce3-bf92-ff897925761d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.443631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.444412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.444697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.445021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.445759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.447372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.451534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:53.525903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:53.539867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d275bba-bb06-4ce3-bf92-ff897925761d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.576074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee314e-35cb-44aa-b810-0be929376364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.577108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee314e-35cb-44aa-b810-0be929376364 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.577602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee314e-35cb-44aa-b810-0be929376364 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.578109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee314e-35cb-44aa-b810-0be929376364 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.579107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee314e-35cb-44aa-b810-0be929376364 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.580685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee314e-35cb-44aa-b810-0be929376364 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.596232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 17/32] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:17:53 2022] POST /identity/v3/projects => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:53.597517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.706673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2978e-e13b-40ed-ac26-62d992cc3ba8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.719423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 16/33] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jun 23 11:17:53 2022] POST /identity/v3/roles => generated 219 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:53.721882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1bd2-69c2-49ed-9c3d-cc2e048b8a4c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.722480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1bd2-69c2-49ed-9c3d-cc2e048b8a4c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.722948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1bd2-69c2-49ed-9c3d-cc2e048b8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.746250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-857e1bd2-69c2-49ed-9c3d-cc2e048b8a4c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:53.746457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.747190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.747481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.747765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.748558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:53.748910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.749785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-857e1bd2-69c2-49ed-9c3d-cc2e048b8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:53.750466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.761021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 18/34] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:53.766795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.823154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:53.842008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 17/35] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:53.889532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1bd2-69c2-49ed-9c3d-cc2e048b8a4c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.899936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62fdd0-9e5b-41c2-805d-65533dd09263 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.951476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.953301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.954259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.955011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] PATH_INFO: `/v3/users/91e4179db7ac4303a76052708306002a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.957046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] RBAC: Authorizing `identity:get_user(user_id=91e4179db7ac4303a76052708306002a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.959627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.963284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 19/36] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:17:53 2022] GET /identity/v3/users/91e4179db7ac4303a76052708306002a => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:53.970236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.003099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:54.031182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1bd2-69c2-49ed-9c3d-cc2e048b8a4c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.073996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620bc5c-3593-4c28-8706-a873d4bf1bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.074714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620bc5c-3593-4c28-8706-a873d4bf1bd4 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.074998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620bc5c-3593-4c28-8706-a873d4bf1bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.075274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620bc5c-3593-4c28-8706-a873d4bf1bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.076054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620bc5c-3593-4c28-8706-a873d4bf1bd4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.077629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620bc5c-3593-4c28-8706-a873d4bf1bd4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.092255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jun 23 11:17:53 2022] POST /identity/v3/roles => generated 225 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:54.093580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a1fa9-9df9-4e1f-96f8-c4ecf622f678 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.093870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a1fa9-9df9-4e1f-96f8-c4ecf622f678 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.094146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a1fa9-9df9-4e1f-96f8-c4ecf622f678 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.095395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 19/38] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:54.096478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e29050-f8b0-4c90-a334-44728c97ebbb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.096879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e29050-f8b0-4c90-a334-44728c97ebbb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.097163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e29050-f8b0-4c90-a334-44728c97ebbb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.098380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 20/39] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:54.101296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837b67-7e96-4e55-9c0f-9865642159eb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.101659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837b67-7e96-4e55-9c0f-9865642159eb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.102008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62837b67-7e96-4e55-9c0f-9865642159eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.106680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175f8fa-2add-42bf-ab92-d5c0b61b2884 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.121019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-62837b67-7e96-4e55-9c0f-9865642159eb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:54.122273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-62837b67-7e96-4e55-9c0f-9865642159eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.126788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:54.148373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a399a-b0be-4291-a013-315475617990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.149641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a399a-b0be-4291-a013-315475617990 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.150139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a399a-b0be-4291-a013-315475617990 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.150421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a399a-b0be-4291-a013-315475617990 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.151863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a399a-b0be-4291-a013-315475617990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.153446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a399a-b0be-4291-a013-315475617990 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.155421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 20/40] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:54.156773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c564cc-653a-4330-8661-590132b49297 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.157104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c564cc-653a-4330-8661-590132b49297 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.157386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c564cc-653a-4330-8661-590132b49297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.175620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d8c564cc-653a-4330-8661-590132b49297 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:54.177270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d8c564cc-653a-4330-8661-590132b49297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.202467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 21/41] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:54.203455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62837b67-7e96-4e55-9c0f-9865642159eb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.270238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 21/42] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:54.271077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c564cc-653a-4330-8661-590132b49297 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.278098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:54.314686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62837b67-7e96-4e55-9c0f-9865642159eb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.352127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.353439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.353724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.354005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] PATH_INFO: `/v3/domains/default/users/91e4179db7ac4303a76052708306002a/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.356402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=91e4179db7ac4303a76052708306002a, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.357913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.372972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 22/43] 10.222.0.66 () {58 vars in 1361 bytes} [Thu Jun 23 11:17:54 2022] PUT /identity/v3/domains/default/users/91e4179db7ac4303a76052708306002a/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:54.373741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.390724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c564cc-653a-4330-8661-590132b49297 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.413092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:54.445103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.445831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.446147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.446427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.447276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.448809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.471257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:54.505477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df50b14-5ecc-4c79-82a8-bb02ebe6a40a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.542433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:54.554471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a0609-4c36-4501-a885-572ae87bb242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.555445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0609-4c36-4501-a885-572ae87bb242 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.555886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0609-4c36-4501-a885-572ae87bb242 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.556174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a0609-4c36-4501-a885-572ae87bb242 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.557701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a0609-4c36-4501-a885-572ae87bb242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.559230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a0609-4c36-4501-a885-572ae87bb242 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.561107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 23/45] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:54.567438 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.795033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb95926-7148-4d80-af0e-be6c6ce2694e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.832198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35958299-fb7a-4d6e-ad91-b47a8c338c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.832912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958299-fb7a-4d6e-ad91-b47a8c338c69 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.833195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958299-fb7a-4d6e-ad91-b47a8c338c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.833471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958299-fb7a-4d6e-ad91-b47a8c338c69 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.834193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35958299-fb7a-4d6e-ad91-b47a8c338c69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.835636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35958299-fb7a-4d6e-ad91-b47a8c338c69 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.862294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/projects => generated 312 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:56.456704 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258497-7a30-451b-bf16-f6ccb3404f6c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.457296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258497-7a30-451b-bf16-f6ccb3404f6c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.457296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258497-7a30-451b-bf16-f6ccb3404f6c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.458671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 24/47] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:56.464763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6090ff4-f8fb-4865-bc6f-d347a3afbfbd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.465200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6090ff4-f8fb-4865-bc6f-d347a3afbfbd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.465414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6090ff4-f8fb-4865-bc6f-d347a3afbfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.483870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b6090ff4-f8fb-4865-bc6f-d347a3afbfbd None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:56.485147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b6090ff4-f8fb-4865-bc6f-d347a3afbfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:56.506452 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:56.555096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:56.578847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258497-7a30-451b-bf16-f6ccb3404f6c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.687820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258497-7a30-451b-bf16-f6ccb3404f6c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.723259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e871f-445a-40f0-8826-4a2806cb89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.723983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e871f-445a-40f0-8826-4a2806cb89f0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.724263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e871f-445a-40f0-8826-4a2806cb89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.724536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e871f-445a-40f0-8826-4a2806cb89f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.735295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e871f-445a-40f0-8826-4a2806cb89f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d38e871f-445a-40f0-8826-4a2806cb89f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:17:56.743038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:17:56.744153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:17:56.745154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 25/49] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:17:56.752126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6090ff4-f8fb-4865-bc6f-d347a3afbfbd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.852942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6090ff4-f8fb-4865-bc6f-d347a3afbfbd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.881079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5baa9-6e6a-43c1-9fd4-e3911e219219 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.881503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5baa9-6e6a-43c1-9fd4-e3911e219219 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.881854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5baa9-6e6a-43c1-9fd4-e3911e219219 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.883302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 26/50] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:56.888605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e875dc-2b18-44a9-a4ae-76154e1c913c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.888963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e875dc-2b18-44a9-a4ae-76154e1c913c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.889067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.889244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e875dc-2b18-44a9-a4ae-76154e1c913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.889775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.890059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.890333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.891099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:56.891414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.892883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.901643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 25/51] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:56.907600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.928217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:57.016474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917d94c-707f-482c-917f-68e0c39a288f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:57.019700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-58e875dc-2b18-44a9-a4ae-76154e1c913c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:57.020986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-58e875dc-2b18-44a9-a4ae-76154e1c913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:57.055425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:57.055425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:57.055425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:57.055425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] PATH_INFO: `/v3/users/91e4179db7ac4303a76052708306002a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:57.056268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] RBAC: Authorizing `identity:get_user(user_id=91e4179db7ac4303a76052708306002a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:57.057976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:57.059781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 26/52] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:17:56 2022] GET /identity/v3/users/91e4179db7ac4303a76052708306002a => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:57.065506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:57.075278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:57.093630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 27/53] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:57.118711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e875dc-2b18-44a9-a4ae-76154e1c913c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:57.153287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:57.168702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75ba88-5af0-477c-98b9-f92b0fede74c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:57.202653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:57.203478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:57.203764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:57.204045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:57.205365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:57.206853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:57.208532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 27/54] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:57.214441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:57.222494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e875dc-2b18-44a9-a4ae-76154e1c913c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:57.257455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:57.258246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:57.258927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:57.259408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:57.260414 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:57.261945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:57.263554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:57.271595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:57.321737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e662b9-01f8-4f56-a251-75d2a70b4487 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:57.328358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:57.357609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1599f-6f71-4d7c-b9ec-ca8bf03059d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:57.358285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1599f-6f71-4d7c-b9ec-ca8bf03059d9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:57.358573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1599f-6f71-4d7c-b9ec-ca8bf03059d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:57.358855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1599f-6f71-4d7c-b9ec-ca8bf03059d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:57.359697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1599f-6f71-4d7c-b9ec-ca8bf03059d9 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.domain.id=default, user.id=91e4179db7ac4303a76052708306002a) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:57.360009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1599f-6f71-4d7c-b9ec-ca8bf03059d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:57.361503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1599f-6f71-4d7c-b9ec-ca8bf03059d9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:57.367514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 28/56] 10.222.0.66 () {56 vars in 1322 bytes} [Thu Jun 23 11:17:57 2022] GET /identity/v3/role_assignments?user.id=91e4179db7ac4303a76052708306002a&scope.domain.id=default&role.id=2072cf36ca344da697b097313f411f3b => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:57.374000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c2e04-0ad7-410b-a0d4-5c240d47c951 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:57.413852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26ae84-26e7-4f27-b61b-814a52296363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:57.414530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ae84-26e7-4f27-b61b-814a52296363 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:57.414931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ae84-26e7-4f27-b61b-814a52296363 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:57.415949 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ae84-26e7-4f27-b61b-814a52296363 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:57.416756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26ae84-26e7-4f27-b61b-814a52296363 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:57.418250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26ae84-26e7-4f27-b61b-814a52296363 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:57.451030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 29/57] 10.222.0.66 () {60 vars in 1140 bytes} [Thu Jun 23 11:17:57 2022] POST /identity/v3/projects => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:59.499277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123434a-b5ef-4424-ba41-b3703002f055 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:59.499871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123434a-b5ef-4424-ba41-b3703002f055 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:59.499871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123434a-b5ef-4424-ba41-b3703002f055 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:59.501269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 29/58] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:17:59.507683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572e08-5874-46fe-964e-cdf296a6403c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:59.508385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572e08-5874-46fe-964e-cdf296a6403c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:59.508607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572e08-5874-46fe-964e-cdf296a6403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:59.531355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e5572e08-5874-46fe-964e-cdf296a6403c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:59.532592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e5572e08-5874-46fe-964e-cdf296a6403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:59.626834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 30/59] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:17:59.651972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123434a-b5ef-4424-ba41-b3703002f055 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:59.679663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:59.797309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123434a-b5ef-4424-ba41-b3703002f055 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:59.838502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d224db8-0783-4b15-96bb-e5491a318a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:59.839434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224db8-0783-4b15-96bb-e5491a318a03 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:59.839722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224db8-0783-4b15-96bb-e5491a318a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:59.840003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d224db8-0783-4b15-96bb-e5491a318a03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:59.841365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d224db8-0783-4b15-96bb-e5491a318a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:59.842821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d224db8-0783-4b15-96bb-e5491a318a03 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:59.845280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 30/60] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:17:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:59.855008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572e08-5874-46fe-964e-cdf296a6403c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:59.904374 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:59.987635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5572e08-5874-46fe-964e-cdf296a6403c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.027105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc054-a882-48f9-a616-30cfa9bd1433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.027773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc054-a882-48f9-a616-30cfa9bd1433 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.028037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc054-a882-48f9-a616-30cfa9bd1433 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.028310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc054-a882-48f9-a616-30cfa9bd1433 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.029055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cc054-a882-48f9-a616-30cfa9bd1433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.030522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cc054-a882-48f9-a616-30cfa9bd1433 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.059500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 31/61] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:17:59 2022] POST /identity/v3/users => generated 275 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:03.424185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a5e7-5f10-4b72-8bd6-13d837a2171c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.425087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a5e7-5f10-4b72-8bd6-13d837a2171c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.425533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a5e7-5f10-4b72-8bd6-13d837a2171c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.427079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 31/62] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:03.432610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c1e59-ee06-4936-94aa-49d78c1e0b48 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.433411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c1e59-ee06-4936-94aa-49d78c1e0b48 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.433851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c1e59-ee06-4936-94aa-49d78c1e0b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.456643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6a5c1e59-ee06-4936-94aa-49d78c1e0b48 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:03.457487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db0cae-21ff-4df7-b8cc-0ddb8efc4ce7 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.457899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6a5c1e59-ee06-4936-94aa-49d78c1e0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:03.458177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db0cae-21ff-4df7-b8cc-0ddb8efc4ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.458618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db0cae-21ff-4df7-b8cc-0ddb8efc4ce7 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.460311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:03.466064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a49f8-3d23-440e-b409-b0f92184faf3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.466712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a49f8-3d23-440e-b409-b0f92184faf3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.467179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a49f8-3d23-440e-b409-b0f92184faf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.484997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5d8a49f8-3d23-440e-b409-b0f92184faf3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:03.486652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5d8a49f8-3d23-440e-b409-b0f92184faf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:03.543723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 32/64] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:03.545425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e553bc7-0e70-4b6f-9960-06b4d7e3698f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.545904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e553bc7-0e70-4b6f-9960-06b4d7e3698f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.546379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e553bc7-0e70-4b6f-9960-06b4d7e3698f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.547821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 33/65] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:03.562705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 33/66] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:03.570268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58f0ac-0af6-4b9b-8d36-c08ed7b99e00 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.570835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58f0ac-0af6-4b9b-8d36-c08ed7b99e00 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.571302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58f0ac-0af6-4b9b-8d36-c08ed7b99e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.574937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a49f8-3d23-440e-b409-b0f92184faf3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:03.590475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8c58f0ac-0af6-4b9b-8d36-c08ed7b99e00 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:03.591882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c58f0ac-0af6-4b9b-8d36-c08ed7b99e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:03.605686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:03.615449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:03.681996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 34/67] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:03.685576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58f0ac-0af6-4b9b-8d36-c08ed7b99e00 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:03.717083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a49f8-3d23-440e-b409-b0f92184faf3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:03.752887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:03.754473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.755141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.755564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.768287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:03.776414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:03.777303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:03.778049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 34/68] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:03.778667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:03.811725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58f0ac-0af6-4b9b-8d36-c08ed7b99e00 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:03.847344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5ecd4-6818-4937-ba8f-2abb846325b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:03.848155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ecd4-6818-4937-ba8f-2abb846325b9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.848439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ecd4-6818-4937-ba8f-2abb846325b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.848738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5ecd4-6818-4937-ba8f-2abb846325b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.860161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5ecd4-6818-4937-ba8f-2abb846325b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:03.862004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-35c5ecd4-6818-4937-ba8f-2abb846325b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:03.867686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:03.868649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:03.869423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:03.869998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 35/69] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:03.870773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3b129-e151-45d4-844a-b4da73610b5d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.871058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3b129-e151-45d4-844a-b4da73610b5d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.871338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3b129-e151-45d4-844a-b4da73610b5d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.872860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 36/70] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:03.873354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3b129-e151-45d4-844a-b4da73610b5d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:03.889333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:03.892738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c834b0-91e3-489e-b3e3-b4468edda074 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:03.925904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410699e-4dea-4c55-a1f0-4d853c2d7f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:03.926750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410699e-4dea-4c55-a1f0-4d853c2d7f61 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.927036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410699e-4dea-4c55-a1f0-4d853c2d7f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.927326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410699e-4dea-4c55-a1f0-4d853c2d7f61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.937335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410699e-4dea-4c55-a1f0-4d853c2d7f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5410699e-4dea-4c55-a1f0-4d853c2d7f61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:03.945902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:03.946843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:03.947587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:03.948518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e829c8-9568-4406-b17d-a76430a6a107 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.948753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e829c8-9568-4406-b17d-a76430a6a107 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.949036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e829c8-9568-4406-b17d-a76430a6a107 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.950448 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 36/72] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:03.951044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e829c8-9568-4406-b17d-a76430a6a107 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:03.983182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3b129-e151-45d4-844a-b4da73610b5d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.018520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6f4f6-3deb-4db0-af50-0f64bad179f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.019184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f4f6-3deb-4db0-af50-0f64bad179f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.019469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f4f6-3deb-4db0-af50-0f64bad179f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.019743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6f4f6-3deb-4db0-af50-0f64bad179f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.020504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f4f6-3deb-4db0-af50-0f64bad179f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:04.020837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f4f6-3deb-4db0-af50-0f64bad179f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.022238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6f4f6-3deb-4db0-af50-0f64bad179f3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.033488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 37/73] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:04.034708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106e0c-8752-4897-b9f3-ae876208f9c1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.034994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106e0c-8752-4897-b9f3-ae876208f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.035269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0106e0c-8752-4897-b9f3-ae876208f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.051375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a0106e0c-8752-4897-b9f3-ae876208f9c1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:04.052611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0106e0c-8752-4897-b9f3-ae876208f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:04.060075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e829c8-9568-4406-b17d-a76430a6a107 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.093893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.094567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.094824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.095133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.095872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:04.096172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.097644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.099848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.107413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 37/74] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:04.108178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.134040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 38/75] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:04.135429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6a63d-097f-429f-8973-95e7dce304e9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.135719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6a63d-097f-429f-8973-95e7dce304e9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.135989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6a63d-097f-429f-8973-95e7dce304e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.142461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.159776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e1f6a63d-097f-429f-8973-95e7dce304e9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:04.161103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e1f6a63d-097f-429f-8973-95e7dce304e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:04.212768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911d974-0ceb-4faf-b4e1-e5047c7e4c38 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.231212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 39/76] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:04.232105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6a63d-097f-429f-8973-95e7dce304e9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.252507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.253491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.253976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.254457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.255375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:04.255848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.257446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.266364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 38/77] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:04.267244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.325498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.339379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6a63d-097f-429f-8973-95e7dce304e9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.369063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2135d-be34-4de4-b8d2-4620a5555a11 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.373598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.374470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.374757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.375026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] PATH_INFO: `/v3/users/91e4179db7ac4303a76052708306002a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.376207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] RBAC: Authorizing `identity:get_user(user_id=91e4179db7ac4303a76052708306002a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.377678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.379312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 40/78] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/users/91e4179db7ac4303a76052708306002a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:04.380062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.384822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.402107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.403004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.403291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.403567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.417827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.419290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.420999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 39/79] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:04.421768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.482628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80075f-4a99-433e-aec9-d0e86f3be5fe None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.516138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.516972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.517253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.517523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.521287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91babb8b-bf33-4348-988b-462e989b24d8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.527781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:04.535463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:04.536335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:04.537326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 41/80] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:04.538301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.542604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.559650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.560486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.560809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.561091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.562306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.563782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.565531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 40/81] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:04.566306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.601089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.641929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4122db-a712-4705-9d10-cca2c1f5fc8d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.668267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3294d12-5f4f-4d9a-9eaf-249d0e430bcd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.678851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.679743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.680088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.680405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.681679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.683148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.684847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 42/82] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:04.685613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.706531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.707198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.707484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.707774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.760988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.774113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.775610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.784339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10acfd8-87c4-4551-89e4-c6f190ae40d1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.812968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.819780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.820439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.820783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.821069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.870973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 41/83] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:04.871807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.896434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.897951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.956205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.971000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aca04f-4956-4523-a0ed-1303d6f4e3f2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.996349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 43/84] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:04.997443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.011817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.012536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.012824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.013101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.013851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:05.014158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.015540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.023794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 42/85] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:05.024587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.027024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.096447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04117e84-190f-45f1-86f8-52167388abc2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.131942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc54dca-ae96-4cc5-af68-b2410363fece None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.135218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.135927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.136204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.136479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.137252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.138693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.160118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 44/86] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:05.161082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.176496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.177215 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.177512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.177794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.199598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.259074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.260620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.267277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.288921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d91ed0-4862-40d2-a6e3-f74c38e98193 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.332701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.333009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.333285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.333556 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.335363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.337039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.338623 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 45/87] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:05.339391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.394199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 43/88] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:05.400510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.467953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa82cb9-032c-4d87-a0ba-a1d3e6b5db91 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.470248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.516075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.517586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.518079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.518370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.520212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.522196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.525179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 46/89] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:05.526453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.528808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237d19c-1544-4f33-8a06-5facdaa00567 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.558037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.572753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.573641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.573922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.574196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.575410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.576892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.578536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 44/90] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:05.579295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.658564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523e56d-c636-4cec-97f8-2242ffaad779 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.682297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d90e6-838c-4f3d-985d-6247effdc5cc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.701169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.709016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.710317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.710610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.711168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.712740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=91e4179db7ac4303a76052708306002a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:05.713458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.715419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.720627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.721540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.721821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.722099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.723341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.724845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 47/91] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/role_assignments?user.id=91e4179db7ac4303a76052708306002a&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:05.725024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.725667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.726711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 45/92] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:05.732607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.821767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.839477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd57db-27c7-4c83-b195-07c1dba05866 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.842612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ab7c3-821d-4637-bc75-46551c233c20 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.876739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.877420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.877715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.877980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.879113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=7cef473d3c5b4a9a8c54a0d160cca389) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:05.879509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.881053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.881263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.881718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.882000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.882272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.887307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 48/93] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/role_assignments?user.id=7cef473d3c5b4a9a8c54a0d160cca389&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:05.888162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.942897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.961858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.963377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:06.023616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f959-00e3-4cbb-9397-d496adc4ca6e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:06.079298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 46/94] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:06.091068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:06.097875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:06.098554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:06.098836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:06.099111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:06.099974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] RBAC: Adding query filter params (role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=7cef473d3c5b4a9a8c54a0d160cca389) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:06.100267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:06.102594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:06.109513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 49/95] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/role_assignments?user.id=7cef473d3c5b4a9a8c54a0d160cca389&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:06.228914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:06.254159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433d785-8c56-4d7b-a089-b3ed900e4377 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:06.300373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1815ad5-7d25-4d08-8dd1-008d725a9ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:06.301311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815ad5-7d25-4d08-8dd1-008d725a9ecc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:06.301595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815ad5-7d25-4d08-8dd1-008d725a9ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:06.301871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1815ad5-7d25-4d08-8dd1-008d725a9ecc None admin] PATH_INFO: `/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:06.303143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1815ad5-7d25-4d08-8dd1-008d725a9ecc None admin] RBAC: Authorizing `identity:get_project(project_id=6d0060c0f5f34576a9c4d58d22a32ba5)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:06.304653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1815ad5-7d25-4d08-8dd1-008d725a9ecc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:06.307275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 47/96] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:06 2022] GET /identity/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5 => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:06.313016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:06.339516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:06.445165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04374f5-8e3d-4f5b-a284-d5826e86de12 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:06.481587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25222549-fe83-4ffe-b922-531a750aa8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:06.482325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25222549-fe83-4ffe-b922-531a750aa8ba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:06.482611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25222549-fe83-4ffe-b922-531a750aa8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:06.482886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25222549-fe83-4ffe-b922-531a750aa8ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:06.483724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25222549-fe83-4ffe-b922-531a750aa8ba None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=6d0060c0f5f34576a9c4d58d22a32ba5, user.id=7cef473d3c5b4a9a8c54a0d160cca389) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:06.484040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25222549-fe83-4ffe-b922-531a750aa8ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:06.485554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25222549-fe83-4ffe-b922-531a750aa8ba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:06.491639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 50/97] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:06 2022] GET /identity/v3/role_assignments?user.id=7cef473d3c5b4a9a8c54a0d160cca389&scope.project.id=6d0060c0f5f34576a9c4d58d22a32ba5&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:07.763732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b690-9a97-46ec-9973-30ae9b64ef77 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:07.764240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b690-9a97-46ec-9973-30ae9b64ef77 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:07.764311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05b690-9a97-46ec-9973-30ae9b64ef77 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:07.765855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 48/98] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:07.771221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72d51-d348-4f4c-ae3e-e7fa3e12e027 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:07.771988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72d51-d348-4f4c-ae3e-e7fa3e12e027 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:07.772452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb72d51-d348-4f4c-ae3e-e7fa3e12e027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:07.801657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7bb72d51-d348-4f4c-ae3e-e7fa3e12e027 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:07.803135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7bb72d51-d348-4f4c-ae3e-e7fa3e12e027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:07.874300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 51/99] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:07.897764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b690-9a97-46ec-9973-30ae9b64ef77 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:07.960942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a3e8b-2584-4d34-93b2-81676f8cd554 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:07.961770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a3e8b-2584-4d34-93b2-81676f8cd554 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:07.962357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a3e8b-2584-4d34-93b2-81676f8cd554 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:07.964494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 52/100] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:07.969321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b06a9-961c-481f-8892-6428780ed545 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:07.969869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b06a9-961c-481f-8892-6428780ed545 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:07.970343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b06a9-961c-481f-8892-6428780ed545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:07.995864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-789b06a9-961c-481f-8892-6428780ed545 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:07.997602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-789b06a9-961c-481f-8892-6428780ed545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:08.001446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:08.059752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05b690-9a97-46ec-9973-30ae9b64ef77 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:08.099335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 53/101] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:08.113198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:08.114027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:08.114313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:08.114593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:08.135349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:08.143267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:08.144124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:08.144942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 49/102] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:08.149908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b06a9-961c-481f-8892-6428780ed545 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:08.165682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:08.186486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:08.312123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b06a9-961c-481f-8892-6428780ed545 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:08.330605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01620d3e-78b7-46b9-a0af-fb8a8707b561 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:08.386044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:08.386763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:08.387052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:08.387328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:08.388207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:08.388526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:08.389942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:08.404515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 50/103] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:08.410202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:08.410322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:08.411161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:08.411445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:08.411720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:08.412962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:08.414513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:08.418695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 54/104] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:08.421566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:08.437653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:08.537195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:08.561488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9f4d4-e547-4d8b-8bf8-f1af8529c3eb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:08.610651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144041d2-82d9-4f30-9a49-282bb155d4ea None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:08.638209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:08.639119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:08.639405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:08.639750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] PATH_INFO: `/v3/users/e3e7590a11de4e2e83cddb754fe4a649` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:08.645452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0b950-de57-457f-8fcd-eeac9ed1c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:08.646126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b950-de57-457f-8fcd-eeac9ed1c2a4 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:08.646410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b950-de57-457f-8fcd-eeac9ed1c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:08.646691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0b950-de57-457f-8fcd-eeac9ed1c2a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:08.647408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0b950-de57-457f-8fcd-eeac9ed1c2a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:08.648936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0b950-de57-457f-8fcd-eeac9ed1c2a4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:08.671705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] RBAC: Authorizing `identity:get_user(user_id=e3e7590a11de4e2e83cddb754fe4a649)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:08.674504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:08.678516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 51/105] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:08 2022] GET /identity/v3/users/e3e7590a11de4e2e83cddb754fe4a649 => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:08.680955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 55/106] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:18:08 2022] POST /identity/v3/projects => generated 302 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:08.684516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:08.797535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55744b-764f-4fe4-8f82-4b7bce456d8f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:08.833634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:08.842421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:08.843105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:08.843393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:08.843674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:08.943483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:08.945174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:09.002789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad701c7-029d-49f4-a6fa-0756b30fedf8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.003297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad701c7-029d-49f4-a6fa-0756b30fedf8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.003370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad701c7-029d-49f4-a6fa-0756b30fedf8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.004748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 56/107] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:09.015013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5d63-7ddd-447e-8127-c807006dc95a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.015304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5d63-7ddd-447e-8127-c807006dc95a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.015583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5d63-7ddd-447e-8127-c807006dc95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.035638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d14a5d63-7ddd-447e-8127-c807006dc95a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:09.037121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d14a5d63-7ddd-447e-8127-c807006dc95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:09.101128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.120823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 57/108] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:09.131415 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 52/109] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:18:09.137058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5d63-7ddd-447e-8127-c807006dc95a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.159740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.249738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.251857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5d63-7ddd-447e-8127-c807006dc95a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.292289 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f0a4f-8bf8-4549-9998-a7b8cd0bc424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.293215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0a4f-8bf8-4549-9998-a7b8cd0bc424 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.293500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0a4f-8bf8-4549-9998-a7b8cd0bc424 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.293781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f0a4f-8bf8-4549-9998-a7b8cd0bc424 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.295021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f0a4f-8bf8-4549-9998-a7b8cd0bc424 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:09.296539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f0a4f-8bf8-4549-9998-a7b8cd0bc424 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:09.299558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 58/110] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:09.300808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7862a-9c40-451b-a806-c4a00726c467 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.301251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7862a-9c40-451b-a806-c4a00726c467 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.301691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7862a-9c40-451b-a806-c4a00726c467 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.303994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 59/111] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:09.311154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7862a-9c40-451b-a806-c4a00726c467 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.325148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab206ee6-b28c-48ee-943d-1508610d7448 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.363773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1a55-67ed-4228-9668-7f84da6615e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.365429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1a55-67ed-4228-9668-7f84da6615e1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.365858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1a55-67ed-4228-9668-7f84da6615e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.366274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1a55-67ed-4228-9668-7f84da6615e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.378209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1a55-67ed-4228-9668-7f84da6615e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-6ffc1a55-67ed-4228-9668-7f84da6615e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:09.386359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:09.387374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:09.388297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:09.390322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 53/112] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:09.391769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c06f7-2041-41d2-906f-68aa6b057d64 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.392193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c06f7-2041-41d2-906f-68aa6b057d64 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.392606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c06f7-2041-41d2-906f-68aa6b057d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.406281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.413254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-624c06f7-2041-41d2-906f-68aa6b057d64 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:09.414906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-624c06f7-2041-41d2-906f-68aa6b057d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:09.455116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7862a-9c40-451b-a806-c4a00726c467 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.488684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 54/113] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:09.490077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabda63-dac4-426c-9e71-9200208052ac None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.490378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabda63-dac4-426c-9e71-9200208052ac None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.490671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabda63-dac4-426c-9e71-9200208052ac None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.491946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 55/114] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:09.496571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843928c1-6de0-482a-bb44-861e303dcc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.497568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843928c1-6de0-482a-bb44-861e303dcc6f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.498005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843928c1-6de0-482a-bb44-861e303dcc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.498430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843928c1-6de0-482a-bb44-861e303dcc6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.499429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843928c1-6de0-482a-bb44-861e303dcc6f None admin] RBAC: Adding query filter params (role.id=7eb5f88d39ef40edac0c0a3628afa406, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=e3e7590a11de4e2e83cddb754fe4a649) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:09.499947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843928c1-6de0-482a-bb44-861e303dcc6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:09.501153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabda63-dac4-426c-9e71-9200208052ac None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.501792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843928c1-6de0-482a-bb44-861e303dcc6f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:09.508328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 60/115] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/role_assignments?user.id=e3e7590a11de4e2e83cddb754fe4a649&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=7eb5f88d39ef40edac0c0a3628afa406 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:09.509882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930008d-c8a6-44e4-a020-4afc9433bb79 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.510366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930008d-c8a6-44e4-a020-4afc9433bb79 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.510915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930008d-c8a6-44e4-a020-4afc9433bb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.532458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d930008d-c8a6-44e4-a020-4afc9433bb79 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:09.534172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d930008d-c8a6-44e4-a020-4afc9433bb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:09.542630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.612027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 61/116] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:09.613329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930008d-c8a6-44e4-a020-4afc9433bb79 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.632493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabda63-dac4-426c-9e71-9200208052ac None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.670264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.670966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.671252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.671529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.672416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:09.676604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:09.676604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:09.685425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 56/117] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:09.686396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.695220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.750667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930008d-c8a6-44e4-a020-4afc9433bb79 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.784940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.791639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.792458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.792762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.793043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.804412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:09.804933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bf386-19c1-4670-8e20-f406fd8b2a78 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:09.812050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:09.812963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 62/118] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:09.814804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.861450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ea070-2e92-4555-b7fd-92e58fc74551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.862508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ea070-2e92-4555-b7fd-92e58fc74551 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.863678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ea070-2e92-4555-b7fd-92e58fc74551 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.863965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ea070-2e92-4555-b7fd-92e58fc74551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.877152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ea070-2e92-4555-b7fd-92e58fc74551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-040ea070-2e92-4555-b7fd-92e58fc74551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:09.887292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:09.888182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:09.888995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:09.890400 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 57/119] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:09.892785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6085c0-4591-495c-8c81-9264b05ff0c4 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.892785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6085c0-4591-495c-8c81-9264b05ff0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.892785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6085c0-4591-495c-8c81-9264b05ff0c4 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.892785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 58/120] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:09.893358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6085c0-4591-495c-8c81-9264b05ff0c4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.940899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe959-26a6-4266-9024-7ed7d96662df None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.953330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.981260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.982301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.982691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.983103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] PATH_INFO: `/v3/users/91e4179db7ac4303a76052708306002a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.984541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] RBAC: Authorizing `identity:get_user(user_id=91e4179db7ac4303a76052708306002a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:09.986154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:09.988258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 63/121] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/users/91e4179db7ac4303a76052708306002a => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:09.989116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.029299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6085c0-4591-495c-8c81-9264b05ff0c4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.072563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad91553-ec73-452f-ad1a-a202a8d279c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.073675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91553-ec73-452f-ad1a-a202a8d279c4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.073969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91553-ec73-452f-ad1a-a202a8d279c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.074252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91553-ec73-452f-ad1a-a202a8d279c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.075286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91553-ec73-452f-ad1a-a202a8d279c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:10.075601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91553-ec73-452f-ad1a-a202a8d279c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.077031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91553-ec73-452f-ad1a-a202a8d279c4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.088519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 59/122] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.095705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb5be-915e-4ca4-986d-5fac5ab6e784 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.095997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb5be-915e-4ca4-986d-5fac5ab6e784 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.096270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abb5be-915e-4ca4-986d-5fac5ab6e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.113781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.120583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-23abb5be-915e-4ca4-986d-5fac5ab6e784 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:10.121825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-23abb5be-915e-4ca4-986d-5fac5ab6e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:10.132300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a10b2b-5e29-400e-ae36-37fecebb280d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.180787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.181512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.181799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.182322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.183527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:10.183841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.185757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.201857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 64/123] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.202791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.209153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 60/124] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:10.214186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abb5be-915e-4ca4-986d-5fac5ab6e784 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.276106 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.338594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abb5be-915e-4ca4-986d-5fac5ab6e784 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.355150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce38dcd-571d-436f-8427-5ef31b6c9bd6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.377730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.378670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.378958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.379252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.380476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.382018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.384013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 61/125] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.384654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.389190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.405163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.406777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.407742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.408279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.409978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.412516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.416180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 65/126] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.417536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.498033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd628a4e-bbeb-4bd6-a82c-b4d8f878af7f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.542047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fdd52-a071-4c32-bf9b-762c549cfac9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.545454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.546553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.547549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.547961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.551080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.552498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.553207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.562383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 62/127] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.563559 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.582175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.583009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.583292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.583532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.598832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:10.614809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:10.615656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:10.616419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:10.618611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 66/128] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:10.618844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.645248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.676501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b9fa9-302c-47ff-a4e6-4ed5d8e17dc6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.712333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.713241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.713521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.713796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] PATH_INFO: `/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.714977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] RBAC: Authorizing `identity:get_project(project_id=6d0060c0f5f34576a9c4d58d22a32ba5)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.716505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.718493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 63/129] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.719081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.744505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96923834-bfac-4391-a44f-dab65044e008 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.782756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.784029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.784523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.785017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/91e4179db7ac4303a76052708306002a/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.787385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] RBAC: Authorizing `identity:create_grant(project_id=1dd5a2a2262d43ccbc624cf96e1b6180, user_id=91e4179db7ac4303a76052708306002a, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.789273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.804334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 67/130] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:10 2022] PUT /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/91e4179db7ac4303a76052708306002a/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:10.806518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.826603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf88b37-4531-4b19-ae94-911c4c3d5380 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.858669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.866503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.868401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.868401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.868401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.869642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.871529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.873531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 64/131] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.874389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.891180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.950332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b61ee3-3324-4336-a0bc-47378b8e6041 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.029184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.029886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.030184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.030456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.031248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:11.031558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.033022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.054188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef2ca3-a652-4804-a9b4-543f67523464 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.059748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 68/132] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:11.060649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.105332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.106281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.106566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.106843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] PATH_INFO: `/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5/users/7cef473d3c5b4a9a8c54a0d160cca389/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.109322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] RBAC: Authorizing `identity:create_grant(project_id=6d0060c0f5f34576a9c4d58d22a32ba5, user_id=7cef473d3c5b4a9a8c54a0d160cca389, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.111124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.131774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 65/133] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:10 2022] PUT /identity/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5/users/7cef473d3c5b4a9a8c54a0d160cca389/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:11.133644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.214772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:11.219899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e969ff-34bf-4136-80d3-729167eddc33 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.265140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:11.299585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.300565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.300880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.301158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/7cef473d3c5b4a9a8c54a0d160cca389/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.303908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] RBAC: Authorizing `identity:create_grant(project_id=1dd5a2a2262d43ccbc624cf96e1b6180, user_id=7cef473d3c5b4a9a8c54a0d160cca389, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.305494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.337219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 69/134] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:11 2022] PUT /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/7cef473d3c5b4a9a8c54a0d160cca389/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:11.348037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c06207-d131-42fd-934b-e2900a873bdc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.398362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5626c0-ef0e-44e7-b952-31815696c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.399985 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5626c0-ef0e-44e7-b952-31815696c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.400273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5626c0-ef0e-44e7-b952-31815696c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.400557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5626c0-ef0e-44e7-b952-31815696c1d2 None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.401934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5626c0-ef0e-44e7-b952-31815696c1d2 None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.403465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5626c0-ef0e-44e7-b952-31815696c1d2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.405366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 66/135] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:11 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:11.410985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.563107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b791-5453-4b73-bf87-9c8eb0dbdf8a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.582305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b910f-b0c0-4944-879b-c4557e6dcab6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.582595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b910f-b0c0-4944-879b-c4557e6dcab6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.583024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b910f-b0c0-4944-879b-c4557e6dcab6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.584746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 67/136] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:11.591222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd7f1-8635-45da-9a3b-bef4b808e9d9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.591617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd7f1-8635-45da-9a3b-bef4b808e9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.591957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd7f1-8635-45da-9a3b-bef4b808e9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.617075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d53cd7f1-8635-45da-9a3b-bef4b808e9d9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:11.618860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d53cd7f1-8635-45da-9a3b-bef4b808e9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:11.622952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.623839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.624120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.624395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.625624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.627082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.628998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 70/137] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:11 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:11.635651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.672217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:11.766075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 68/138] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:11.803635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc7ea6-81d3-4c89-abef-f569a6cbe09e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.832334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd7f1-8635-45da-9a3b-bef4b808e9d9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.863403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.864346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.864630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.864975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/7cef473d3c5b4a9a8c54a0d160cca389/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.869316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] RBAC: Authorizing `identity:create_grant(project_id=1dd5a2a2262d43ccbc624cf96e1b6180, user_id=7cef473d3c5b4a9a8c54a0d160cca389, role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.870818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.893572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 71/139] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:11 2022] PUT /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/7cef473d3c5b4a9a8c54a0d160cca389/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:11.930866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:11.975583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd7f1-8635-45da-9a3b-bef4b808e9d9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.014423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb42301-5864-4944-8c43-d8dedb2af838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.015499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb42301-5864-4944-8c43-d8dedb2af838 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.015811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb42301-5864-4944-8c43-d8dedb2af838 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.016094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb42301-5864-4944-8c43-d8dedb2af838 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.017469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb42301-5864-4944-8c43-d8dedb2af838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.019015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb42301-5864-4944-8c43-d8dedb2af838 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.021329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 69/140] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:12.029823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.124020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:12.157616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82781854-23e0-4a8b-8902-b68d83aad282 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.200536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3083652-d828-4867-8e1c-6e448ba149b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.201312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083652-d828-4867-8e1c-6e448ba149b0 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.201596 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083652-d828-4867-8e1c-6e448ba149b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.201930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3083652-d828-4867-8e1c-6e448ba149b0 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.202661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083652-d828-4867-8e1c-6e448ba149b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.204189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3083652-d828-4867-8e1c-6e448ba149b0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.233083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 72/141] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:12 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:12.251911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e9b2a-f2bf-42ed-bbdf-605c45c22e3e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.252232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e9b2a-f2bf-42ed-bbdf-605c45c22e3e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.252554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e9b2a-f2bf-42ed-bbdf-605c45c22e3e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.254147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 70/142] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:12.261352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b099f6-b482-4a06-9a54-378a3f62207a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.261770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b099f6-b482-4a06-9a54-378a3f62207a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.262089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b099f6-b482-4a06-9a54-378a3f62207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.285587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-81b099f6-b482-4a06-9a54-378a3f62207a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:12.286869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-81b099f6-b482-4a06-9a54-378a3f62207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:12.387368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 73/143] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:12.426228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e9b2a-f2bf-42ed-bbdf-605c45c22e3e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.549647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e9b2a-f2bf-42ed-bbdf-605c45c22e3e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.590585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.591410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.591694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.591977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.593995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:12.604630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:12.612566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:12.613432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:12.614164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 71/144] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:12.621998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b099f6-b482-4a06-9a54-378a3f62207a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.710125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:12.761207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b099f6-b482-4a06-9a54-378a3f62207a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.803934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.804607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.804954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.805479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.805946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:12.806256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.807680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.817616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 74/145] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:12.824094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.936617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1842e-7ca2-41f5-8878-f6d8bd30c060 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.976290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.977423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.977666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.977943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] PATH_INFO: `/v3/users/e3e7590a11de4e2e83cddb754fe4a649` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.979185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e7590a11de4e2e83cddb754fe4a649)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.980679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.982363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 72/146] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:12 2022] GET /identity/v3/users/e3e7590a11de4e2e83cddb754fe4a649 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:12.988022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.099726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da27bd-c754-4ecd-be51-e7a0ca28cac2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.134359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:13.136405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0f182-9b0f-42f8-bd0a-ad781199253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.137447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0f182-9b0f-42f8-bd0a-ad781199253f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.137735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0f182-9b0f-42f8-bd0a-ad781199253f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.138013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0f182-9b0f-42f8-bd0a-ad781199253f None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.139528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0f182-9b0f-42f8-bd0a-ad781199253f None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.141008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0f182-9b0f-42f8-bd0a-ad781199253f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.143123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 75/147] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:12 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:13.148892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.235688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:13.280208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08652b-9522-4c93-88c8-8e902a54f5b1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.318718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f431a21-2472-4f00-bb3f-4f2f75accbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.319565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f431a21-2472-4f00-bb3f-4f2f75accbf7 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.319851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f431a21-2472-4f00-bb3f-4f2f75accbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.320196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f431a21-2472-4f00-bb3f-4f2f75accbf7 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/e3e7590a11de4e2e83cddb754fe4a649/roles/7eb5f88d39ef40edac0c0a3628afa406` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.322413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f431a21-2472-4f00-bb3f-4f2f75accbf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1dd5a2a2262d43ccbc624cf96e1b6180, user_id=e3e7590a11de4e2e83cddb754fe4a649, role_id=7eb5f88d39ef40edac0c0a3628afa406)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.323876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f431a21-2472-4f00-bb3f-4f2f75accbf7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.339868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 73/148] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:13 2022] PUT /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/users/e3e7590a11de4e2e83cddb754fe4a649/roles/7eb5f88d39ef40edac0c0a3628afa406 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:13.520607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da556f-b7a8-4923-86b8-e6effe3e105f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.521150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da556f-b7a8-4923-86b8-e6effe3e105f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.521444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da556f-b7a8-4923-86b8-e6effe3e105f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.523959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 76/149] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:13.529942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3714b0-8a1c-418d-a5b8-04df8d15ffe2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.530234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3714b0-8a1c-418d-a5b8-04df8d15ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.530516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3714b0-8a1c-418d-a5b8-04df8d15ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.553697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5a3714b0-8a1c-418d-a5b8-04df8d15ffe2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:13.555528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5a3714b0-8a1c-418d-a5b8-04df8d15ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.655918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 74/150] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:13.701020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da556f-b7a8-4923-86b8-e6effe3e105f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.829669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da556f-b7a8-4923-86b8-e6effe3e105f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.870174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.871011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.871293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.871568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.883730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:13.891329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:13.892162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:13.893021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 77/151] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:13.898755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3714b0-8a1c-418d-a5b8-04df8d15ffe2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.964025 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.040841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3714b0-8a1c-418d-a5b8-04df8d15ffe2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.082323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.083016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.083305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.083586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.084355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:14.084664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.086163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.100764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 75/152] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:14.106225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.187560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.235089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2190d94-f5b9-4ad5-974c-90cace32a1ab None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.276484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b66af3-e419-4a68-a4ce-6dfd7492d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.277440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b66af3-e419-4a68-a4ce-6dfd7492d100 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.277728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b66af3-e419-4a68-a4ce-6dfd7492d100 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.277990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b66af3-e419-4a68-a4ce-6dfd7492d100 None admin] PATH_INFO: `/v3/users/91e4179db7ac4303a76052708306002a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.279299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b66af3-e419-4a68-a4ce-6dfd7492d100 None admin] RBAC: Authorizing `identity:get_user(user_id=91e4179db7ac4303a76052708306002a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.280864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b66af3-e419-4a68-a4ce-6dfd7492d100 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.282552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 78/153] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/users/91e4179db7ac4303a76052708306002a => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:14.288467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.448978 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c251e-12c4-4c0a-90f6-03b10ee94df4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.463838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.489521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.490109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.490395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.490672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.560335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.561874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.654808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6123cd-adf2-496f-8a3f-03bd01abf31c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.655676 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6123cd-adf2-496f-8a3f-03bd01abf31c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.656086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6123cd-adf2-496f-8a3f-03bd01abf31c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.661523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 79/154] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:14.662815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 76/155] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:14.663182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f965-f4eb-489c-8b28-3c7d7ae75bb0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.663617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f965-f4eb-489c-8b28-3c7d7ae75bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.664079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f965-f4eb-489c-8b28-3c7d7ae75bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.673997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.700602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.701228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6d62f965-f4eb-489c-8b28-3c7d7ae75bb0 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:14.702423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6d62f965-f4eb-489c-8b28-3c7d7ae75bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.830249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 80/156] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:14.831838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb63a1-999f-48ff-ac26-1d96c9d948e1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.873998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f965-f4eb-489c-8b28-3c7d7ae75bb0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.881627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.883318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.883318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.883318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.889554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.891051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.896739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 77/157] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:14.899059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.972739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:15.025658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f965-f4eb-489c-8b28-3c7d7ae75bb0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.074930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:15.092009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3979e75-24f5-4d43-99b0-aa89259ccd24 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.096613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4e6cc-23d1-400b-b80f-6179c1341521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.097811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e6cc-23d1-400b-b80f-6179c1341521 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.098347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e6cc-23d1-400b-b80f-6179c1341521 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.098805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e6cc-23d1-400b-b80f-6179c1341521 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.110528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4e6cc-23d1-400b-b80f-6179c1341521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-bde4e6cc-23d1-400b-b80f-6179c1341521 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:15.118579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:15.119486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:15.120231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:15.122628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 81/158] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:15.124148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fa500-1805-4ec2-b480-01852ab3042d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.124619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fa500-1805-4ec2-b480-01852ab3042d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.125105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fa500-1805-4ec2-b480-01852ab3042d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.126574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 82/159] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:15.128364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fa500-1805-4ec2-b480-01852ab3042d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.153229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b748e8-9f35-4abd-8ae7-7a3e4845387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.153925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b748e8-9f35-4abd-8ae7-7a3e4845387d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.154208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b748e8-9f35-4abd-8ae7-7a3e4845387d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.154485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b748e8-9f35-4abd-8ae7-7a3e4845387d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.155340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b748e8-9f35-4abd-8ae7-7a3e4845387d None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=91e4179db7ac4303a76052708306002a) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:15.155660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b748e8-9f35-4abd-8ae7-7a3e4845387d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:15.157257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b748e8-9f35-4abd-8ae7-7a3e4845387d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:15.170670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 78/160] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/role_assignments?user.id=91e4179db7ac4303a76052708306002a&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:15.172009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0433-6ea3-4949-ba91-178a672bf78a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.172300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0433-6ea3-4949-ba91-178a672bf78a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.172577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0433-6ea3-4949-ba91-178a672bf78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.203874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9d3f0433-6ea3-4949-ba91-178a672bf78a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:15.205728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9d3f0433-6ea3-4949-ba91-178a672bf78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:15.246017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fa500-1805-4ec2-b480-01852ab3042d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.262035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:15.285816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.286912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.287378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.287954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.289028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:15.289526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:15.291327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:15.301448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 83/161] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:15.307789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.358302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 79/162] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:15.411915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f0433-6ea3-4949-ba91-178a672bf78a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.431199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8aa3ed-11d7-4fb6-95f9-c0a7e7559474 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.472776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.474251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.474721 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.475177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.476656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:15.478992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:15.481368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 84/163] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:15 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:15.488173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.556128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:15.595252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:15.649193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b5ed1-844a-4f8f-80a5-b44bc52f673d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.659004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f0433-6ea3-4949-ba91-178a672bf78a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.701973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.704329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.708288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.708875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.797528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.798364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.798644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.798918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.823341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:15.825217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:15.853344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:15.861272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:15.862208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:15.862967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 80/164] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:15.869700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.878806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:15.954950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 85/165] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:15.961184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.129972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab157b-1b72-478a-9f09-c3c62abae2bf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.133370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f9034-c5c5-4d76-8efd-ad54adba3720 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.175011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.176896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.177318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.177914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.179390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:16.180134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.182335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.190924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:16.205846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.206974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.207411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.207823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.209250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.210968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.214952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 81/166] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:16.215367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 86/167] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:15 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:16.219127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.229918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.251416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:16.419328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85062df-706c-4ca7-9505-ea36a421aa3b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.433179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef64c-a4c9-4f09-8b8d-27d2bf23f061 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.460325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deb520-2855-4419-b6f0-8620046dd8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.461506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deb520-2855-4419-b6f0-8620046dd8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.461928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deb520-2855-4419-b6f0-8620046dd8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.462339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deb520-2855-4419-b6f0-8620046dd8f2 None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.464476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66deb520-2855-4419-b6f0-8620046dd8f2 None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.466108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66deb520-2855-4419-b6f0-8620046dd8f2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.468281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 87/168] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:16.473866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ba2d-4efe-4610-afb6-b1cb6fc5f47c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.474328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ba2d-4efe-4610-afb6-b1cb6fc5f47c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.474840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ba2d-4efe-4610-afb6-b1cb6fc5f47c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.476351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 88/169] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:16.477772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ba2d-4efe-4610-afb6-b1cb6fc5f47c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.526328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553413e-2385-4887-a82d-11e935678697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.527007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553413e-2385-4887-a82d-11e935678697 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.527289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553413e-2385-4887-a82d-11e935678697 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.527649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553413e-2385-4887-a82d-11e935678697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.528403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553413e-2385-4887-a82d-11e935678697 None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=7cef473d3c5b4a9a8c54a0d160cca389) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:16.529407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553413e-2385-4887-a82d-11e935678697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.530189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553413e-2385-4887-a82d-11e935678697 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.556746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 82/170] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/role_assignments?user.id=7cef473d3c5b4a9a8c54a0d160cca389&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:16.556746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff373e-bfe9-4b7a-8eab-4f940bcdcb79 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.556746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff373e-bfe9-4b7a-8eab-4f940bcdcb79 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.556746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff373e-bfe9-4b7a-8eab-4f940bcdcb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.604215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:16.604436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-25ff373e-bfe9-4b7a-8eab-4f940bcdcb79 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:16.604436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-25ff373e-bfe9-4b7a-8eab-4f940bcdcb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:16.634620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ba2d-4efe-4610-afb6-b1cb6fc5f47c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.693968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.694937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.695658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.696080 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.699472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:16.719117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 83/171] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:16.757395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff373e-bfe9-4b7a-8eab-4f940bcdcb79 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.845865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.847381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.946030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:16.975554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 89/172] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:16.981287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.994981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff373e-bfe9-4b7a-8eab-4f940bcdcb79 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.109470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.110349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.110633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.110915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.133379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:17.141813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:17.143571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:17.145032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 84/173] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:17.146065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d491-08f9-400e-b25a-85abc7dd2cfc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.153601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.205509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.206916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.207397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.207865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] PATH_INFO: `/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.209386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] RBAC: Authorizing `identity:get_project(project_id=6d0060c0f5f34576a9c4d58d22a32ba5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.211624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.213716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 90/174] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/projects/6d0060c0f5f34576a9c4d58d22a32ba5 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:17.219990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.241196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:17.304549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d64b7-2565-4b3e-8fe3-687c8bb557d7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.315698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:17.344126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dfcc9-4855-40bc-89e2-1a161e970301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.344832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfcc9-4855-40bc-89e2-1a161e970301 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.345338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfcc9-4855-40bc-89e2-1a161e970301 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.345650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dfcc9-4855-40bc-89e2-1a161e970301 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.346439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dfcc9-4855-40bc-89e2-1a161e970301 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:17.347125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dfcc9-4855-40bc-89e2-1a161e970301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.348672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dfcc9-4855-40bc-89e2-1a161e970301 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.358723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 85/175] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:17.360867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba230bf-1fc8-40aa-8336-7eabb196d9dd None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.360867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba230bf-1fc8-40aa-8336-7eabb196d9dd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.361054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba230bf-1fc8-40aa-8336-7eabb196d9dd None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.362987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 86/176] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:17.367822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba230bf-1fc8-40aa-8336-7eabb196d9dd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.424102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60071bd6-1c92-49c3-803f-00fa54455848 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.467412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af258eba-734d-4931-ae8e-a1c6ad640535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.468577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af258eba-734d-4931-ae8e-a1c6ad640535 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.469085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af258eba-734d-4931-ae8e-a1c6ad640535 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.469554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af258eba-734d-4931-ae8e-a1c6ad640535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.470737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af258eba-734d-4931-ae8e-a1c6ad640535 None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=6d0060c0f5f34576a9c4d58d22a32ba5, user.id=7cef473d3c5b4a9a8c54a0d160cca389) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:17.471264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af258eba-734d-4931-ae8e-a1c6ad640535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.472946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af258eba-734d-4931-ae8e-a1c6ad640535 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.482501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 91/177] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:17 2022] GET /identity/v3/role_assignments?user.id=7cef473d3c5b4a9a8c54a0d160cca389&scope.project.id=6d0060c0f5f34576a9c4d58d22a32ba5&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:17.485795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1854c4c-e016-47f9-ad2e-39e3176d0b84 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.486292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1854c4c-e016-47f9-ad2e-39e3176d0b84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.486787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1854c4c-e016-47f9-ad2e-39e3176d0b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.495603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba230bf-1fc8-40aa-8336-7eabb196d9dd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.517613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:17.525270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f1854c4c-e016-47f9-ad2e-39e3176d0b84 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:17.526508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f1854c4c-e016-47f9-ad2e-39e3176d0b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.550840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a35bac-9861-4e38-a09a-6996da4c4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.551852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35bac-9861-4e38-a09a-6996da4c4e83 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.552141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35bac-9861-4e38-a09a-6996da4c4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.552417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a35bac-9861-4e38-a09a-6996da4c4e83 None admin] PATH_INFO: `/v3/users/7cef473d3c5b4a9a8c54a0d160cca389` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.553895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35bac-9861-4e38-a09a-6996da4c4e83 None admin] RBAC: Authorizing `identity:get_user(user_id=7cef473d3c5b4a9a8c54a0d160cca389)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.557326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a35bac-9861-4e38-a09a-6996da4c4e83 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.559325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 87/178] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:17 2022] GET /identity/v3/users/7cef473d3c5b4a9a8c54a0d160cca389 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:17.568578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b6368-772c-4e50-99d8-d814002c1525 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.568892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b6368-772c-4e50-99d8-d814002c1525 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.569163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b6368-772c-4e50-99d8-d814002c1525 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.570807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 88/179] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:17.577810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b6368-772c-4e50-99d8-d814002c1525 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.681801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 92/180] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:17.682558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9ebd5-30ba-4fab-b90d-5de92e6e2be5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.682850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9ebd5-30ba-4fab-b90d-5de92e6e2be5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.684154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9ebd5-30ba-4fab-b90d-5de92e6e2be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.709150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1ed9ebd5-30ba-4fab-b90d-5de92e6e2be5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:17.710882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ed9ebd5-30ba-4fab-b90d-5de92e6e2be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.750091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:17.752527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b6368-772c-4e50-99d8-d814002c1525 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.786692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 93/181] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:17.787552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9ebd5-30ba-4fab-b90d-5de92e6e2be5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.789866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34baf7-09bb-4273-a621-9abc52c86355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.790530 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34baf7-09bb-4273-a621-9abc52c86355 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.790813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34baf7-09bb-4273-a621-9abc52c86355 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.791087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34baf7-09bb-4273-a621-9abc52c86355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.840562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:17.859666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34baf7-09bb-4273-a621-9abc52c86355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.861210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34baf7-09bb-4273-a621-9abc52c86355 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.888763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9ebd5-30ba-4fab-b90d-5de92e6e2be5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.923637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfe8a6-085d-41a1-8168-07c489fab9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.924447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe8a6-085d-41a1-8168-07c489fab9ed None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.924762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe8a6-085d-41a1-8168-07c489fab9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.925053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe8a6-085d-41a1-8168-07c489fab9ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.935657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfe8a6-085d-41a1-8168-07c489fab9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4cdfe8a6-085d-41a1-8168-07c489fab9ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:17.943575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:17.944608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:17.945646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 94/182] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:17.946449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583e20-e7a6-46ba-b6b9-754fa34a37b8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.946449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583e20-e7a6-46ba-b6b9-754fa34a37b8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.946586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45583e20-e7a6-46ba-b6b9-754fa34a37b8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.947972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 95/183] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:17.953199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f778fb0-4f9d-46d8-bffe-806acc2f993e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.953199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f778fb0-4f9d-46d8-bffe-806acc2f993e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.953199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f778fb0-4f9d-46d8-bffe-806acc2f993e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.953199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 96/184] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:17.953199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f778fb0-4f9d-46d8-bffe-806acc2f993e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.965779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 89/185] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:17.967069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184d22-a6ba-4ecc-a9f2-bd321871ae5b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.967355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184d22-a6ba-4ecc-a9f2-bd321871ae5b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.967628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19184d22-a6ba-4ecc-a9f2-bd321871ae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.984109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-19184d22-a6ba-4ecc-a9f2-bd321871ae5b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:17.985360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-19184d22-a6ba-4ecc-a9f2-bd321871ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.990212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.055569 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 90/186] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:18.056787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19184d22-a6ba-4ecc-a9f2-bd321871ae5b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.071520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.074420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f778fb0-4f9d-46d8-bffe-806acc2f993e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.110035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5b10e-93ab-4507-9f9e-9cb6167e7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.110850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b10e-93ab-4507-9f9e-9cb6167e7de3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.111134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b10e-93ab-4507-9f9e-9cb6167e7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.111409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b10e-93ab-4507-9f9e-9cb6167e7de3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.121605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5b10e-93ab-4507-9f9e-9cb6167e7de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-dab5b10e-93ab-4507-9f9e-9cb6167e7de3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:18.129744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:18.130652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:18.131434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 97/187] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:18.132152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608151c2-54dd-4fe4-9b95-1fc81eb81e1f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.132433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608151c2-54dd-4fe4-9b95-1fc81eb81e1f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.132841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608151c2-54dd-4fe4-9b95-1fc81eb81e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.149732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-608151c2-54dd-4fe4-9b95-1fc81eb81e1f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:18.150996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-608151c2-54dd-4fe4-9b95-1fc81eb81e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:18.157996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19184d22-a6ba-4ecc-a9f2-bd321871ae5b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.194659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.195503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.195782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.196054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.196840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:18.197146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.198797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.207576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 91/188] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.208368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.222911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 98/189] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:18.223752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608151c2-54dd-4fe4-9b95-1fc81eb81e1f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.255868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.284617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.310299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03c4bd-c05a-49fd-bc7f-8e799898828d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.336816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608151c2-54dd-4fe4-9b95-1fc81eb81e1f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.342914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.343789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.344095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.344350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.345578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.347037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.348806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 92/190] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.349583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.372234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.373082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.373353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.373623 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.374790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.376226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.377870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 99/191] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.378609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.461733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36107d-8e7a-4a06-b67a-24ea8bd96f59 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.475661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.488566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bc0ef-2b7e-409f-9521-fe2680e1a244 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.495616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.496317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.496603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.496906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.497665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:18.497969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.499393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.507520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 93/192] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.508529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.512912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.524384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.525319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.525598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.525876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] PATH_INFO: `/v3/users/a27b79760be84b3a869b4060b94bb51b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.540979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] RBAC: Authorizing `identity:get_user(user_id=a27b79760be84b3a869b4060b94bb51b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.542427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.544143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 100/193] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/users/a27b79760be84b3a869b4060b94bb51b => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.544949 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.613298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eecbea-2fe1-4841-a76f-da395ae8acbd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.647379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173a9b9-096d-485d-a772-b194f4449499 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.649039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.650660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.650660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.650660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.661532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:18.669461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:18.670359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:18.671138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 94/194] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:18.671793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.686441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.687160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.687440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.687720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.688554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] RBAC: Adding query filter params (role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=7cef473d3c5b4a9a8c54a0d160cca389) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:18.688904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.690398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.697774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 101/195] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/role_assignments?user.id=7cef473d3c5b4a9a8c54a0d160cca389&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.698586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.712600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.751801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.797141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb9742-3231-430e-9f71-8766e1087125 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.814821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f738e9-9a67-4857-b3e2-4f1f15794a5a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.834728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.835426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.835744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.836022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.836786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.838321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.852159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.853225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.853525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.853763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] PATH_INFO: `/v3/users/a27b79760be84b3a869b4060b94bb51b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.855557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] RBAC: Authorizing `identity:get_user(user_id=a27b79760be84b3a869b4060b94bb51b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.857221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.859005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 102/196] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/users/a27b79760be84b3a869b4060b94bb51b => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.864211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.875882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 95/197] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:18 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:18.876675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.968656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.005430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00357c9d-b97f-46ae-9238-2e1c40dd854f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.014491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccd76b-7faa-471b-91fd-03b9eb3d345d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.036301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.050741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.051489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.051771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.052050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.061235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.061235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.061465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.062409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.062516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:19.062807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.064211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.074061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 96/198] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:19.075200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.132863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.134401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.189261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bdec-0301-45cb-a70a-43966d7ba422 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.222524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.232960 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.233648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.233922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.234195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.252203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 103/199] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:19.253603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.305109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.318608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.321523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.373406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b43c2-877d-4bdf-89f2-19116878a32b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.409586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.410397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.410683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.410960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] PATH_INFO: `/v3/users/e3e7590a11de4e2e83cddb754fe4a649` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.412178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] RBAC: Authorizing `identity:get_user(user_id=e3e7590a11de4e2e83cddb754fe4a649)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.413838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.416287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 104/200] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/users/e3e7590a11de4e2e83cddb754fe4a649 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:19.417215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.453540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 97/201] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:19.454430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.475756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.548603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.551320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec47d2-2e38-421d-9e72-989b734fdb30 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.569631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16804e0c-2d55-4282-bc01-601c928d1c2f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.603469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.604467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.604886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.605255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.606567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.607924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.608330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.609179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.609604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.610077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.615265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 105/202] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:19.615265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.694504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.697373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.742403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674d13-a810-404d-ac84-3c555739aa33 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.759085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.783056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.784409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.784986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.785517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.786946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.788837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.791370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 106/203] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:19.792441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.798765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.823196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 98/204] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:19.824545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.913766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a354d8f-3eb9-4def-a0d6-548fa527c69f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.950446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.951078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.951381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.951821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.952649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=a27b79760be84b3a869b4060b94bb51b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:19.953001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.954446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.968750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 107/205] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/role_assignments?user.id=a27b79760be84b3a869b4060b94bb51b&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:19.968750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.992752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c7d5-b1ae-4719-9357-3fe4ad56b594 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.068598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:20.077416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.078726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.080039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.084070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.085291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] RBAC: Adding query filter params (role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=a27b79760be84b3a869b4060b94bb51b) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:20.085930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.087618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:20.099939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 99/206] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/role_assignments?user.id=a27b79760be84b3a869b4060b94bb51b&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:20.144590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402b516-209a-4edc-b8c4-d24ca0c95abf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.189381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c316b7d-74e2-420a-873f-fe25dbc00fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.190709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316b7d-74e2-420a-873f-fe25dbc00fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.191212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316b7d-74e2-420a-873f-fe25dbc00fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.192024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316b7d-74e2-420a-873f-fe25dbc00fb4 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.193582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316b7d-74e2-420a-873f-fe25dbc00fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.195446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316b7d-74e2-420a-873f-fe25dbc00fb4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:20.197651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 108/207] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:20.204635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:20.274490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:20.350934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f368e7-7576-4441-9dba-7365afedfeea None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.391750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988da72-1556-4d9b-bead-407a52f05c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.392848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988da72-1556-4d9b-bead-407a52f05c3b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.393347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988da72-1556-4d9b-bead-407a52f05c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.393839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988da72-1556-4d9b-bead-407a52f05c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.394880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988da72-1556-4d9b-bead-407a52f05c3b None admin] RBAC: Adding query filter params (role.id=7eb5f88d39ef40edac0c0a3628afa406, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180, user.id=e3e7590a11de4e2e83cddb754fe4a649) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:20.395390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988da72-1556-4d9b-bead-407a52f05c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.397079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988da72-1556-4d9b-bead-407a52f05c3b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:20.404991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 100/208] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:20 2022] GET /identity/v3/role_assignments?user.id=e3e7590a11de4e2e83cddb754fe4a649&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=7eb5f88d39ef40edac0c0a3628afa406 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:21.133986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e3e02-3edf-4aa6-a497-4ab1d0a399a4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.134486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e3e02-3edf-4aa6-a497-4ab1d0a399a4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.134561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e3e02-3edf-4aa6-a497-4ab1d0a399a4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.136069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 109/209] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:21.141600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974505-be51-487d-8061-f4f1d4de1d94 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.142109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974505-be51-487d-8061-f4f1d4de1d94 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.142576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16974505-be51-487d-8061-f4f1d4de1d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.160320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-16974505-be51-487d-8061-f4f1d4de1d94 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:21.161844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-16974505-be51-487d-8061-f4f1d4de1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:21.230837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 101/210] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:21.245158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aaaad-9110-4e1f-aeb3-703629483972 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.245697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aaaad-9110-4e1f-aeb3-703629483972 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.246171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aaaad-9110-4e1f-aeb3-703629483972 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.248064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 110/211] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:21.253179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071cf8-b2eb-4b78-8205-beb152267528 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.253471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071cf8-b2eb-4b78-8205-beb152267528 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.253750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071cf8-b2eb-4b78-8205-beb152267528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.258387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aaaad-9110-4e1f-aeb3-703629483972 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.273105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5b071cf8-b2eb-4b78-8205-beb152267528 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:21.274339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b071cf8-b2eb-4b78-8205-beb152267528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:21.309703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.353268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 102/212] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:21.383346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aaaad-9110-4e1f-aeb3-703629483972 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.388073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071cf8-b2eb-4b78-8205-beb152267528 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.400944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.429117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.430009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.430293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.430564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.442703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:21.451139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:21.452064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:21.452875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 111/213] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:21.458406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.519820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071cf8-b2eb-4b78-8205-beb152267528 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.556527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.557919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.558443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.559009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.560468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.562453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.564389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 103/214] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:21.570473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.582295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb504c1-1de4-4650-890c-d06c59da6873 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.612075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.620672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.621721 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.622197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.622662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.623717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:21.624320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.625960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.635254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 112/215] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:21.640913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.678497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.682839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f54b1-294d-4f25-b8b0-44e94609edba None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.720762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.721820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.722294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.722770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.723783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.725613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.751758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 104/216] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:21 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:21.757914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdb667-d846-49e3-928a-dc5e802d2376 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.803250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.804739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.805284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.805803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] PATH_INFO: `/v3/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.825072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c83e3fd7ef4f20b8a25d1d74c9c65d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.826928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.829074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 113/217] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:21.835225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.942452 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.950450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01999148-31f8-416b-8163-1154c70d84b7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.988695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.989394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.989677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.989953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.077213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:22.078665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:22.174515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:22.183042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 105/218] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:22.188565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:22.296552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:22.303677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a01d10-553b-4f1b-ae90-202849de83d0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:22.340480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776a64-2c09-45ab-9d52-210d24690966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:22.341325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776a64-2c09-45ab-9d52-210d24690966 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.341603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776a64-2c09-45ab-9d52-210d24690966 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.341870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776a64-2c09-45ab-9d52-210d24690966 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.343099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776a64-2c09-45ab-9d52-210d24690966 None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:22.344604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776a64-2c09-45ab-9d52-210d24690966 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:22.346396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 114/219] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:22 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:22.352480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:22.388613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c377e5-f1c4-4a08-ba67-3eedfa291b0a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.388954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c377e5-f1c4-4a08-ba67-3eedfa291b0a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.389194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c377e5-f1c4-4a08-ba67-3eedfa291b0a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.390703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 115/220] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:22.395902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d36a0-9059-40bb-bf00-a15756d6c13c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.396179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d36a0-9059-40bb-bf00-a15756d6c13c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.396457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d36a0-9059-40bb-bf00-a15756d6c13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.415154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4c1d36a0-9059-40bb-bf00-a15756d6c13c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:22.416358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c1d36a0-9059-40bb-bf00-a15756d6c13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:22.465288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f3bc-fb58-4f3d-b93a-981e56e76bcd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:22.496802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 116/221] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:22.496802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed47c3-6733-4b73-a374-b461c45a12d0 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.496802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed47c3-6733-4b73-a374-b461c45a12d0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.496802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed47c3-6733-4b73-a374-b461c45a12d0 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.496802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 117/222] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:22.502684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cb37-1365-4749-bde2-15175961022c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.503132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cb37-1365-4749-bde2-15175961022c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.503548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5cb37-1365-4749-bde2-15175961022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.525571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:22.526286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.526549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.526820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.527821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=f2c83e3fd7ef4f20b8a25d1d74c9c65d) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:22.527988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:22.529565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:22.537789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b3e5cb37-1365-4749-bde2-15175961022c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:22.538085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 106/223] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:22 2022] GET /identity/v3/role_assignments?user.id=f2c83e3fd7ef4f20b8a25d1d74c9c65d&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:22.538997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b3e5cb37-1365-4749-bde2-15175961022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:22.539586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:22.618581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:22.665229 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 118/224] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:22.680864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041f91-9617-4446-b25c-c97f770dd5a2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:22.692729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cb37-1365-4749-bde2-15175961022c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:22.731579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:22.743860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:22.744745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.745031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.746255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.759063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:22.766963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:22.768017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:22.768918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 107/225] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:22.774576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:22.853445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5cb37-1365-4749-bde2-15175961022c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:22.932477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ff983-f5d5-4200-9660-6cabf42ea1b4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:22.938836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:22.939688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.939973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.940255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.965644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:22.971870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:22.981297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:22.982198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:22.982981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:22.989370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 119/226] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:22.990207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.007397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.008341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.008546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.008856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.009622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:23.009932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.011366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.030158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 108/227] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:23.034472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.134498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:23.149472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034e5e7-2cbc-4065-b1f8-b855367963cf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.214242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.214988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.215211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.215486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.216249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:23.216560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.217977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.221889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47899-008a-4e81-aa70-9f178ba2ca0c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.235460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 120/228] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:23.240682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.290369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.291376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.291716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.291992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] PATH_INFO: `/v3/users/a27b79760be84b3a869b4060b94bb51b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.293302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] RBAC: Authorizing `identity:get_user(user_id=a27b79760be84b3a869b4060b94bb51b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.294780 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.296763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 109/229] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:23 2022] GET /identity/v3/users/a27b79760be84b3a869b4060b94bb51b => generated 283 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:23.302521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.363673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb9042-f66f-48e1-8890-a6a7be535067 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.406145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:23.416446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.417368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.417649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.417923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] PATH_INFO: `/v3/users/a27b79760be84b3a869b4060b94bb51b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.419848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] RBAC: Authorizing `identity:get_user(user_id=a27b79760be84b3a869b4060b94bb51b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.422076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.425329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 121/230] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:23 2022] GET /identity/v3/users/a27b79760be84b3a869b4060b94bb51b => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:23.431104 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.465538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:23.500186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18571e-d31b-457c-8a15-88b17105698a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.546123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.547107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.547393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.547675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.549025 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.550496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.552932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 110/231] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:23 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:23.558893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.636387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddb24e-f912-4b97-b970-7f91729f1beb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.663884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba78d96-33b2-4821-8a22-4cf4dc294dcf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.681123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:23.693326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.694132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.694416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.694717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.699601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.701344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.701751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebec3e4-b8c5-4fd7-956c-ad72a257d163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.702711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec3e4-b8c5-4fd7-956c-ad72a257d163 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.702995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec3e4-b8c5-4fd7-956c-ad72a257d163 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.703273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec3e4-b8c5-4fd7-956c-ad72a257d163 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/a27b79760be84b3a869b4060b94bb51b/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.703490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 122/232] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:23 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:23.706184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebec3e4-b8c5-4fd7-956c-ad72a257d163 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8342a1f31e1493b90b3d0f5807a1339, user_id=a27b79760be84b3a869b4060b94bb51b, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.707642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebec3e4-b8c5-4fd7-956c-ad72a257d163 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.710289 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.729870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 111/233] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:23 2022] PUT /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/a27b79760be84b3a869b4060b94bb51b/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:23.835292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:23.859303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823899a1-a723-4b06-ae46-5e6e3a7a666f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.904518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c5e46-e139-41cf-8f40-fbb0efc37958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.905472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c5e46-e139-41cf-8f40-fbb0efc37958 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.905746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c5e46-e139-41cf-8f40-fbb0efc37958 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.906018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c5e46-e139-41cf-8f40-fbb0efc37958 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/a27b79760be84b3a869b4060b94bb51b/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.908250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c5e46-e139-41cf-8f40-fbb0efc37958 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8342a1f31e1493b90b3d0f5807a1339, user_id=a27b79760be84b3a869b4060b94bb51b, role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.909771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c5e46-e139-41cf-8f40-fbb0efc37958 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.931481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 123/234] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:23 2022] PUT /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/a27b79760be84b3a869b4060b94bb51b/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:24.350993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738cdcb-7a8a-47fd-a1ba-1e8f971bd9f5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.351341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738cdcb-7a8a-47fd-a1ba-1e8f971bd9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.351516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738cdcb-7a8a-47fd-a1ba-1e8f971bd9f5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.352958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 112/235] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:24.358630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491881d4-b12d-4f6d-a7cf-c6527ec7030e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.359097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491881d4-b12d-4f6d-a7cf-c6527ec7030e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.359267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491881d4-b12d-4f6d-a7cf-c6527ec7030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.376956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-491881d4-b12d-4f6d-a7cf-c6527ec7030e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:24.378160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-491881d4-b12d-4f6d-a7cf-c6527ec7030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:24.467528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 124/236] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:24.509304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738cdcb-7a8a-47fd-a1ba-1e8f971bd9f5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:24.605029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10871-328e-46d5-be55-3f6af28ba21b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.605342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10871-328e-46d5-be55-3f6af28ba21b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.605500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce10871-328e-46d5-be55-3f6af28ba21b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.612830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 125/237] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:24.617417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd919968-471d-4885-ab19-8933b040633d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.617718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd919968-471d-4885-ab19-8933b040633d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.617972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd919968-471d-4885-ab19-8933b040633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.631524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738cdcb-7a8a-47fd-a1ba-1e8f971bd9f5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:24.653795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fd919968-471d-4885-ab19-8933b040633d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:24.655001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fd919968-471d-4885-ab19-8933b040633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:24.670264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:24.671094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.671375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.671645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.684807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:24.694188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:24.696283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:24.698169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 113/238] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:24.706350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:24.745992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:24.797690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:24.807671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 126/239] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:24.847315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd919968-471d-4885-ab19-8933b040633d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:24.849918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899c680-959b-4575-a203-54e6148ad2be None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:24.893441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:24.895447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.895707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.895981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.896770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:24.897081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:24.898565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:24.921291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 114/240] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:24.927210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.051342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:25.061609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f74cef-fcbe-4f01-a201-933077b84a67 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.065203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd919968-471d-4885-ab19-8933b040633d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.096918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc42a2-fb50-424a-a9e3-22e5bb466e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.097817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc42a2-fb50-424a-a9e3-22e5bb466e8d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.098098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc42a2-fb50-424a-a9e3-22e5bb466e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.098491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc42a2-fb50-424a-a9e3-22e5bb466e8d None admin] PATH_INFO: `/v3/users/a730c807f35a490bbfdb8c0256801c43` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.101519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73753f61-7c5d-4122-ab3e-12bba2a8927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.102321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753f61-7c5d-4122-ab3e-12bba2a8927a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.102606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753f61-7c5d-4122-ab3e-12bba2a8927a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.102882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73753f61-7c5d-4122-ab3e-12bba2a8927a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.104076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73753f61-7c5d-4122-ab3e-12bba2a8927a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.105596 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73753f61-7c5d-4122-ab3e-12bba2a8927a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.107597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 127/241] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:25.108823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542f1e5-c500-4f1e-8dae-38412635a50e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.109111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542f1e5-c500-4f1e-8dae-38412635a50e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.109385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542f1e5-c500-4f1e-8dae-38412635a50e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.115268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 128/242] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:25.116139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542f1e5-c500-4f1e-8dae-38412635a50e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.118027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc42a2-fb50-424a-a9e3-22e5bb466e8d None admin] RBAC: Authorizing `identity:get_user(user_id=a730c807f35a490bbfdb8c0256801c43)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.119517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc42a2-fb50-424a-a9e3-22e5bb466e8d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.121472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 115/243] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:24 2022] GET /identity/v3/users/a730c807f35a490bbfdb8c0256801c43 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:25.122700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c84e-028a-4cc9-afb3-b90f0550ac3c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.122991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c84e-028a-4cc9-afb3-b90f0550ac3c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.123265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48c84e-028a-4cc9-afb3-b90f0550ac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.139498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5d48c84e-028a-4cc9-afb3-b90f0550ac3c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:25.140754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5d48c84e-028a-4cc9-afb3-b90f0550ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:25.187986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:25.216752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 116/244] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:25.216752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c84e-028a-4cc9-afb3-b90f0550ac3c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.235362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542f1e5-c500-4f1e-8dae-38412635a50e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.272549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.273749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.274208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.274653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.275549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.277304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.301433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:25.302428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 129/245] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:25 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:25.303833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.340957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48c84e-028a-4cc9-afb3-b90f0550ac3c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.426067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.427385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.428761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.429507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.520531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d3f7f-d397-4233-94df-50bef9eefd00 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.527465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.529648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.549221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:25.564332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.564837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.565123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.565403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.579246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:25.587341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:25.588246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:25.589136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:25.591557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 130/246] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:25.606350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.654420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:25.673178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 117/247] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:25.680066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.768748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47012aca-225d-4d83-9a12-91272e5533cf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.814398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.815377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.815808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.816572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.817514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:25.817982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.819528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.829984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641ef0f-1783-413c-be9b-1510177bff98 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.830407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 131/248] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:25.836067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.876362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.877937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.879306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.879787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.881282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.883035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.886581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 118/249] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:25 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:25.892961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:25.893199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.965106 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3039e-f09c-40e7-9c78-b07e3fab452d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.975340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:26.013511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.014795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.015081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.015357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] PATH_INFO: `/v3/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.016971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c83e3fd7ef4f20b8a25d1d74c9c65d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.020782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:26.020782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 132/250] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:25 2022] GET /identity/v3/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:26.026505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.074630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc898aba-8f98-429d-a7fa-88c95ad88137 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.162479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3641ef-0c1d-4223-9715-bdeff3a14f42 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.169477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.170182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.170469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.170743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.171986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] RBAC: Adding query filter params (role.id=7eb5f88d39ef40edac0c0a3628afa406, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=a730c807f35a490bbfdb8c0256801c43) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:26.171986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.173482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:26.179714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:26.187796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 119/251] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:25 2022] GET /identity/v3/role_assignments?user.id=a730c807f35a490bbfdb8c0256801c43&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=7eb5f88d39ef40edac0c0a3628afa406 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:26.213469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db390c26-a4f3-4401-abf5-01ce6a611a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.214798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390c26-a4f3-4401-abf5-01ce6a611a9a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.215280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390c26-a4f3-4401-abf5-01ce6a611a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.215757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db390c26-a4f3-4401-abf5-01ce6a611a9a None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.217456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db390c26-a4f3-4401-abf5-01ce6a611a9a None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.219269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db390c26-a4f3-4401-abf5-01ce6a611a9a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:26.221794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 133/252] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:26 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:26.227580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.283858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dfb9-7b6e-4752-bece-f9948c30dc56 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.284198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dfb9-7b6e-4752-bece-f9948c30dc56 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.284438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dfb9-7b6e-4752-bece-f9948c30dc56 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.285928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 134/253] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:26.291885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1579-e710-4511-b18f-2b5b95529540 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.292181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1579-e710-4511-b18f-2b5b95529540 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.292448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1579-e710-4511-b18f-2b5b95529540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.322853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5e1d1579-e710-4511-b18f-2b5b95529540 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:26.324098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e1d1579-e710-4511-b18f-2b5b95529540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:26.448983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76eaf8-7b6d-4409-8eef-557acf6dba3a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.458759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 135/254] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:26.467513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:26.486203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3ebb4-bb9b-4b26-87d5-45e77624381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.487109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ebb4-bb9b-4b26-87d5-45e77624381d None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.487388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ebb4-bb9b-4b26-87d5-45e77624381d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.487661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3ebb4-bb9b-4b26-87d5-45e77624381d None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.489241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1579-e710-4511-b18f-2b5b95529540 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.489707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3ebb4-bb9b-4b26-87d5-45e77624381d None admin] RBAC: Authorizing `identity:create_grant(project_id=a8342a1f31e1493b90b3d0f5807a1339, user_id=f2c83e3fd7ef4f20b8a25d1d74c9c65d, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.491206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3ebb4-bb9b-4b26-87d5-45e77624381d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:26.507201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 120/255] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:26 2022] PUT /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:26.634635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1579-e710-4511-b18f-2b5b95529540 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.650368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:26.659471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c746bc6-a26b-4c13-9c26-d7a21d4ab326 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.660492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c746bc6-a26b-4c13-9c26-d7a21d4ab326 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.661010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c746bc6-a26b-4c13-9c26-d7a21d4ab326 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.662761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 121/256] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:26.670478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef084e5-1812-45f5-91d3-02398af306b6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.671097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef084e5-1812-45f5-91d3-02398af306b6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.671578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef084e5-1812-45f5-91d3-02398af306b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.675504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.676592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.677057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.677455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.700593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:26.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:26.713118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:26.714160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:26.719368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4ef084e5-1812-45f5-91d3-02398af306b6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:26.720898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4ef084e5-1812-45f5-91d3-02398af306b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:26.726482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 136/257] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:26.732638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.845325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194c5bb-0d15-4c0d-9909-5cc0c6f8b0f3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.882218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.883144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.883601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.884016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.884809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 122/258] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:26.885146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:26.885591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.887217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:26.897170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 137/259] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:26.908753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef084e5-1812-45f5-91d3-02398af306b6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.912577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.995296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.013114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef084e5-1812-45f5-91d3-02398af306b6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.023925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.049432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.050764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.051189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.052173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] PATH_INFO: `/v3/users/a27b79760be84b3a869b4060b94bb51b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.053655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] RBAC: Authorizing `identity:get_user(user_id=a27b79760be84b3a869b4060b94bb51b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.056067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.057958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 123/260] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:26 2022] GET /identity/v3/users/a27b79760be84b3a869b4060b94bb51b => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:27.070745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.161887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb21957-a9e7-4d08-a2cd-348b0081d8a6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.211875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b91d0-88bb-4424-8790-fd35ae0cc801 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.244644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.245619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.245843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.246113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.254611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.255508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.255958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.256397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.270606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:27.278740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:27.279730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:27.280489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 138/261] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:27.286865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.318374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.354507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.356490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.447393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.464644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33588c-da1d-496c-a15e-707991c40a01 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.477071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 124/262] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:27.484166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.529318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.530332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.530908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.532003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.534105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:27.534805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.536966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.557416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 139/263] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:27.564867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.629268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.680773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3a476-1d8c-4a00-b545-bab04fa969bb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.763290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.764676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.765816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.766450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.769648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.771820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.773956 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 125/264] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:27.775999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4351c2-a544-4eb3-86df-8587c877bb7a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.784672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.819525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.820887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.821356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.821828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] PATH_INFO: `/v3/users/a27b79760be84b3a869b4060b94bb51b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.823362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] RBAC: Authorizing `identity:get_user(user_id=a27b79760be84b3a869b4060b94bb51b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.825022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.827307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 140/265] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/users/a27b79760be84b3a869b4060b94bb51b => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:27.832908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.863636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.946957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c03d94-b507-4c1d-98ca-6dd25a4c704a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.977446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e760413-cda8-4014-847c-8ee420098f34 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.991246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.992177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.992466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.992763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.041983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.042598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.045892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.046193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.047057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] RBAC: Adding query filter params (role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=a27b79760be84b3a869b4060b94bb51b) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:28.048326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.049838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:28.065514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 126/266] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/role_assignments?user.id=a27b79760be84b3a869b4060b94bb51b&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:28.101199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.102693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:28.130196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:28.227590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 141/267] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:28.233415 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:28.245492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:28.363659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f0f0-9013-4cec-bfbe-d9165c72b2c9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:28.410853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9320fc0-d8b1-42ab-88a4-38b46057735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.411784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320fc0-d8b1-42ab-88a4-38b46057735e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.412065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320fc0-d8b1-42ab-88a4-38b46057735e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.412345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320fc0-d8b1-42ab-88a4-38b46057735e None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.413690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9320fc0-d8b1-42ab-88a4-38b46057735e None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.415201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9320fc0-d8b1-42ab-88a4-38b46057735e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:28.417341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 127/268] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:28 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:28.423051 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:28.541070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370338dc-d821-41f0-9b0e-63be56f7691e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:28.569070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:28.583971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb3cf0-9d2f-4a3b-8e02-a540e218bc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.584641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3cf0-9d2f-4a3b-8e02-a540e218bc12 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.584945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3cf0-9d2f-4a3b-8e02-a540e218bc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.585435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3cf0-9d2f-4a3b-8e02-a540e218bc12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.586124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3cf0-9d2f-4a3b-8e02-a540e218bc12 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=a27b79760be84b3a869b4060b94bb51b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:28.586445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3cf0-9d2f-4a3b-8e02-a540e218bc12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.587919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3cf0-9d2f-4a3b-8e02-a540e218bc12 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:28.594724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 142/269] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:28 2022] GET /identity/v3/role_assignments?user.id=a27b79760be84b3a869b4060b94bb51b&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:28.657095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5149512-1331-4727-b7f2-2e2658b81aa0 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.657281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5149512-1331-4727-b7f2-2e2658b81aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.657558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5149512-1331-4727-b7f2-2e2658b81aa0 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.659155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 128/270] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:28.664801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1166d-5c15-4af9-b4d7-529d135c6248 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.665098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1166d-5c15-4af9-b4d7-529d135c6248 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.665368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1166d-5c15-4af9-b4d7-529d135c6248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.690183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-80d1166d-5c15-4af9-b4d7-529d135c6248 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:28.691862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-80d1166d-5c15-4af9-b4d7-529d135c6248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:28.783853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 143/271] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:28.820493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5149512-1331-4727-b7f2-2e2658b81aa0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:28.909284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:28.936817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5149512-1331-4727-b7f2-2e2658b81aa0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:28.973413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cc664-08eb-478b-a03c-e7c0b5cc55da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.974597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cc664-08eb-478b-a03c-e7c0b5cc55da None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.975064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cc664-08eb-478b-a03c-e7c0b5cc55da None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.975522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cc664-08eb-478b-a03c-e7c0b5cc55da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.986913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cc664-08eb-478b-a03c-e7c0b5cc55da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-731cc664-08eb-478b-a03c-e7c0b5cc55da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:28.995260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:28.996140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:28.996945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:28.999887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 129/272] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:29.005854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1166d-5c15-4af9-b4d7-529d135c6248 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.082667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35d52-8c72-48bb-a4a1-ac87810b8799 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.083297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35d52-8c72-48bb-a4a1-ac87810b8799 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.083860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35d52-8c72-48bb-a4a1-ac87810b8799 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.085568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 130/273] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:29.092396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd025-fdfc-454c-9c3c-69648f1a56b8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.093081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd025-fdfc-454c-9c3c-69648f1a56b8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.093546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafd025-fdfc-454c-9c3c-69648f1a56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.112574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cbafd025-fdfc-454c-9c3c-69648f1a56b8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:29.114134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cbafd025-fdfc-454c-9c3c-69648f1a56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:29.125792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1166d-5c15-4af9-b4d7-529d135c6248 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.146261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.170212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.170812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.171093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.171369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.172129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:29.172435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.173860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.185928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 144/274] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:29.192275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.201659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 131/275] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:29.221378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd025-fdfc-454c-9c3c-69648f1a56b8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.295005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.299776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1577-1316-47b0-bf33-5eb6e7422c6a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.331744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafd025-fdfc-454c-9c3c-69648f1a56b8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.336362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58877906-aa5a-4006-8a56-66627721cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.337326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877906-aa5a-4006-8a56-66627721cef6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.337591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877906-aa5a-4006-8a56-66627721cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.337873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58877906-aa5a-4006-8a56-66627721cef6 None admin] PATH_INFO: `/v3/users/9afc8426aa1c4c4b95114553b1de5572` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.355525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58877906-aa5a-4006-8a56-66627721cef6 None admin] RBAC: Authorizing `identity:get_user(user_id=9afc8426aa1c4c4b95114553b1de5572)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.357032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58877906-aa5a-4006-8a56-66627721cef6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.358797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 145/276] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/users/9afc8426aa1c4c4b95114553b1de5572 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:29.360067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000e4c-bcfa-4b2e-8235-a8eb0205770b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.360362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000e4c-bcfa-4b2e-8235-a8eb0205770b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.360854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0000e4c-bcfa-4b2e-8235-a8eb0205770b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.363343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 146/277] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:29.364892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0000e4c-bcfa-4b2e-8235-a8eb0205770b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.377252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e64b9-924c-47f3-aadc-7e377a43ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.378213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e64b9-924c-47f3-aadc-7e377a43ed61 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.378500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e64b9-924c-47f3-aadc-7e377a43ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.378770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e64b9-924c-47f3-aadc-7e377a43ed61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.391338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e64b9-924c-47f3-aadc-7e377a43ed61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-766e64b9-924c-47f3-aadc-7e377a43ed61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:29.400875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:29.401788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:29.402562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:29.403148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 132/278] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:29.408835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ace6-2ef8-46da-ac91-7b08b45a1f4b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.409121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ace6-2ef8-46da-ac91-7b08b45a1f4b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.409394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375ace6-2ef8-46da-ac91-7b08b45a1f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.410555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.429458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8375ace6-2ef8-46da-ac91-7b08b45a1f4b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:29.430749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8375ace6-2ef8-46da-ac91-7b08b45a1f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:29.486428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0000e4c-bcfa-4b2e-8235-a8eb0205770b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.500830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 133/279] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:29.501712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375ace6-2ef8-46da-ac91-7b08b45a1f4b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.529697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.530333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.530614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.530888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.531722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, user.id=9afc8426aa1c4c4b95114553b1de5572, scope.system=all) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:29.532033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.533539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.548811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 147/280] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/role_assignments?user.id=9afc8426aa1c4c4b95114553b1de5572&scope.system=all&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:29.548811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.600343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.656435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eab05-45a5-485f-bdc3-9191a8cadd65 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.658326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.668064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375ace6-2ef8-46da-ac91-7b08b45a1f4b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.697531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc1b2c-0a59-4f26-bbff-344b96d1efdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.698373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc1b2c-0a59-4f26-bbff-344b96d1efdf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.698658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc1b2c-0a59-4f26-bbff-344b96d1efdf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.698938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc1b2c-0a59-4f26-bbff-344b96d1efdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.700310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc1b2c-0a59-4f26-bbff-344b96d1efdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.701915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc1b2c-0a59-4f26-bbff-344b96d1efdf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.708423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 148/281] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:29.708423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e378-3056-488a-acca-9343df8b2a9f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.708423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e378-3056-488a-acca-9343df8b2a9f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.708423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e378-3056-488a-acca-9343df8b2a9f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.709238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 149/282] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:29.709601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e378-3056-488a-acca-9343df8b2a9f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.717507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53350c8-6a30-48a2-9893-d402045b8a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.718281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53350c8-6a30-48a2-9893-d402045b8a17 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.718926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53350c8-6a30-48a2-9893-d402045b8a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.718926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53350c8-6a30-48a2-9893-d402045b8a17 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.720161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53350c8-6a30-48a2-9893-d402045b8a17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:29.720161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53350c8-6a30-48a2-9893-d402045b8a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.721564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53350c8-6a30-48a2-9893-d402045b8a17 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.742574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 134/283] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:29.744380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe3d9-3cc0-46c5-b615-1ebc151ce233 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.744682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe3d9-3cc0-46c5-b615-1ebc151ce233 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.745002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efe3d9-3cc0-46c5-b615-1ebc151ce233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.764350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-85efe3d9-3cc0-46c5-b615-1ebc151ce233 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:29.765671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-85efe3d9-3cc0-46c5-b615-1ebc151ce233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:29.838182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 135/284] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:29.839224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe3d9-3cc0-46c5-b615-1ebc151ce233 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.841352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e378-3056-488a-acca-9343df8b2a9f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.888100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.888825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.889111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.889388 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.890129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.891573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.904201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.912351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 150/285] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:29.913404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.955100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.979976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efe3d9-3cc0-46c5-b615-1ebc151ce233 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.024617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.025809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.026262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.026718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] PATH_INFO: `/v3/users/a730c807f35a490bbfdb8c0256801c43` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.028218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=a730c807f35a490bbfdb8c0256801c43)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.029936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.031976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 136/286] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/users/a730c807f35a490bbfdb8c0256801c43 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:30.042351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.057208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797839-2779-434a-a0a5-324ca1c0bffe None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.096218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.097382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.097848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.098255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.113528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:30.121452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:30.122401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:30.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:30.125375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 151/287] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:30.131478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.187372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5736fb3-2d23-4867-ad13-1cc4478a9ba8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.212424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:30.236242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.237171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.237453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.237731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.238949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.240444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.242410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 137/288] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:30 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:30.249732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.252093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:30.271167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53632bd-2621-44b9-88a8-71a5fffe6e4e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.318660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.319367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.320044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.320252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.321123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:30.321588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.323133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.332873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 152/289] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:30.339441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.371283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad799f7-ed6c-4d72-ab02-c4d95bcaab2f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.418868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.420111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.421335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.421682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/a730c807f35a490bbfdb8c0256801c43/roles/7eb5f88d39ef40edac0c0a3628afa406` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.423754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8342a1f31e1493b90b3d0f5807a1339, user_id=a730c807f35a490bbfdb8c0256801c43, role_id=7eb5f88d39ef40edac0c0a3628afa406)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.425301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.444322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 138/290] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:18:30 2022] PUT /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/users/a730c807f35a490bbfdb8c0256801c43/roles/7eb5f88d39ef40edac0c0a3628afa406 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:30.469469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe97af7-b37a-4cb2-8d9b-62e405c7345a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.520762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.521812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.522099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.522373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] PATH_INFO: `/v3/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.523735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] RBAC: Authorizing `identity:get_user(user_id=f2c83e3fd7ef4f20b8a25d1d74c9c65d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.525315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.527037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 153/291] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:30 2022] GET /identity/v3/users/f2c83e3fd7ef4f20b8a25d1d74c9c65d => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:30.532854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.587466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:30.658510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea8ec4-746f-4fca-b753-5868aaee4557 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.705757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.706442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.706723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.706998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.804692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.806139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.856195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:30.944764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 139/292] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:30.950506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.980438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:31.063966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fbef6-1ec5-415c-a9da-47beeb7a0643 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:31.099265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097b2b6-ebb8-4871-8ef8-d59eb97f6b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:31.100160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b2b6-ebb8-4871-8ef8-d59eb97f6b2f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:31.100442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b2b6-ebb8-4871-8ef8-d59eb97f6b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:31.100773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097b2b6-ebb8-4871-8ef8-d59eb97f6b2f None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:31.101989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097b2b6-ebb8-4871-8ef8-d59eb97f6b2f None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:31.103454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097b2b6-ebb8-4871-8ef8-d59eb97f6b2f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:31.105218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 154/293] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:30 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:31.116740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:31.246847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863487e2-de6f-4377-ac32-5a325c54a3c6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:31.281212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84483877-23ee-47d6-8a8f-c3bdadb6c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:31.281897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483877-23ee-47d6-8a8f-c3bdadb6c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:31.282177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483877-23ee-47d6-8a8f-c3bdadb6c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:31.282604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483877-23ee-47d6-8a8f-c3bdadb6c6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:31.283459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483877-23ee-47d6-8a8f-c3bdadb6c6f9 None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=f2c83e3fd7ef4f20b8a25d1d74c9c65d) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:31.283775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483877-23ee-47d6-8a8f-c3bdadb6c6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:31.285267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483877-23ee-47d6-8a8f-c3bdadb6c6f9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:31.291423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 140/294] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:31 2022] GET /identity/v3/role_assignments?user.id=f2c83e3fd7ef4f20b8a25d1d74c9c65d&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:31.841677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1c77d-fd48-448c-b1b8-d871861b3ad1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:31.842048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1c77d-fd48-448c-b1b8-d871861b3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:31.842223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1c77d-fd48-448c-b1b8-d871861b3ad1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:31.843892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 155/295] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:31.849131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ee2f-955f-4cab-9ced-38b294db2ad2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:31.849423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ee2f-955f-4cab-9ced-38b294db2ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:31.849701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4ee2f-955f-4cab-9ced-38b294db2ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:31.866984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bda4ee2f-955f-4cab-9ced-38b294db2ad2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:31.868183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bda4ee2f-955f-4cab-9ced-38b294db2ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:31.870274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:31.942274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 141/296] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:31.968279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1c77d-fd48-448c-b1b8-d871861b3ad1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.062406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:32.076694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1c77d-fd48-448c-b1b8-d871861b3ad1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:32.117947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:32.118664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.118943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.119210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.131264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:32.139625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:32.140511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:32.141335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 156/297] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:32.146943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ee2f-955f-4cab-9ced-38b294db2ad2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.248541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4ee2f-955f-4cab-9ced-38b294db2ad2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:32.283560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:32.284323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.284619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.284910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.285703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:32.286018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:32.287442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:32.293474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:32.297679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 142/298] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:32.303260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.404895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cc9da-27a5-4b80-9a8a-455ed735cce0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:32.440460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831a683-09eb-4ccd-a635-bae8ba7610f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:32.441763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831a683-09eb-4ccd-a635-bae8ba7610f9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.442041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831a683-09eb-4ccd-a635-bae8ba7610f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.442312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831a683-09eb-4ccd-a635-bae8ba7610f9 None admin] PATH_INFO: `/v3/users/9afc8426aa1c4c4b95114553b1de5572` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.443526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831a683-09eb-4ccd-a635-bae8ba7610f9 None admin] RBAC: Authorizing `identity:get_user(user_id=9afc8426aa1c4c4b95114553b1de5572)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:32.445158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831a683-09eb-4ccd-a635-bae8ba7610f9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:32.446838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 157/299] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:32 2022] GET /identity/v3/users/9afc8426aa1c4c4b95114553b1de5572 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:32.452639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.557300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63c75-8b3a-4ab5-b3ac-51241ae3c06c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:32.578872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2cc1-c441-4cde-afea-428cb94d5638 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.578872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2cc1-c441-4cde-afea-428cb94d5638 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.579153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb2cc1-c441-4cde-afea-428cb94d5638 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.581804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 158/300] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:32.586157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243faa47-be38-4d51-bd8f-5b41bde0baa3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.586447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243faa47-be38-4d51-bd8f-5b41bde0baa3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.586729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243faa47-be38-4d51-bd8f-5b41bde0baa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.594480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f382739-90ca-41dd-a11a-917e6e5fe271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:32.595720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f382739-90ca-41dd-a11a-917e6e5fe271 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.596205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f382739-90ca-41dd-a11a-917e6e5fe271 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.596686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f382739-90ca-41dd-a11a-917e6e5fe271 None admin] PATH_INFO: `/v3/system/users/9afc8426aa1c4c4b95114553b1de5572/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.598474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f382739-90ca-41dd-a11a-917e6e5fe271 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9afc8426aa1c4c4b95114553b1de5572, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:32.600154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f382739-90ca-41dd-a11a-917e6e5fe271 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:32.605241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-243faa47-be38-4d51-bd8f-5b41bde0baa3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:32.606700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-243faa47-be38-4d51-bd8f-5b41bde0baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:32.611768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 143/301] 10.222.0.66 () {58 vars in 1334 bytes} [Thu Jun 23 11:18:32 2022] PUT /identity/v3/system/users/9afc8426aa1c4c4b95114553b1de5572/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:32.621152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:32.630974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4114f4-5284-4bcf-ab13-87f0aa2cbe01 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.631754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4114f4-5284-4bcf-ab13-87f0aa2cbe01 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.632183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4114f4-5284-4bcf-ab13-87f0aa2cbe01 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.633976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 144/302] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:32.640402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac30aa-f704-45fc-8f7e-557a0fc943b2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.640820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac30aa-f704-45fc-8f7e-557a0fc943b2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.641185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac30aa-f704-45fc-8f7e-557a0fc943b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.660428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-00ac30aa-f704-45fc-8f7e-557a0fc943b2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:32.661735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-00ac30aa-f704-45fc-8f7e-557a0fc943b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:32.696987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 159/303] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:32.719209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243faa47-be38-4d51-bd8f-5b41bde0baa3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.733059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:32.748958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 145/304] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:32.772052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac30aa-f704-45fc-8f7e-557a0fc943b2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.843893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243faa47-be38-4d51-bd8f-5b41bde0baa3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:32.890314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:32.891166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.891505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.891782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.906357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:32.906821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac30aa-f704-45fc-8f7e-557a0fc943b2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:32.916493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:32.917407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:32.918693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 160/305] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:32.923365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.933067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:32.949061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:32.950343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.950841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.951306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.952789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:32.954469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:32.956785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 146/306] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:32.962618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:33.029647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:33.031871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf6ba6-9c92-49bd-8a43-51e16d67745d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.073806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.074576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.074860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.075310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.076070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:33.076378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:33.077066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a0a7-ec95-455e-a3c9-740b0a9f12fb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.077789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:33.088693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 161/307] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:33.094270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:33.118602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7814ba4-8f6a-4db8-86f1-b770f8c21653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.119326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814ba4-8f6a-4db8-86f1-b770f8c21653 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.119620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814ba4-8f6a-4db8-86f1-b770f8c21653 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.119900 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7814ba4-8f6a-4db8-86f1-b770f8c21653 None admin] PATH_INFO: `/v3/groups` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.120601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7814ba4-8f6a-4db8-86f1-b770f8c21653 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:33.122131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7814ba4-8f6a-4db8-86f1-b770f8c21653 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:33.140694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 147/308] 10.222.0.66 () {60 vars in 1134 bytes} [Thu Jun 23 11:18:32 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:33.142142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5262-ec5a-4b67-abd0-979a932be0d7 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.142438 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5262-ec5a-4b67-abd0-979a932be0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.142717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf5262-ec5a-4b67-abd0-979a932be0d7 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.144187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 148/309] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:33.150633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271510e-fda3-4bcc-9650-c1b53acbfaa3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.150914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271510e-fda3-4bcc-9650-c1b53acbfaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.151245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271510e-fda3-4bcc-9650-c1b53acbfaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.173616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:33.174640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c271510e-fda3-4bcc-9650-c1b53acbfaa3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:33.175884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c271510e-fda3-4bcc-9650-c1b53acbfaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:33.225996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157aae2-a8c4-47de-8390-02007273e12e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.263346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.263786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 149/310] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:33.264150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.264485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.271860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] PATH_INFO: `/v3/users/dec4bbdc981d49009c65500553fba79f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.281220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] RBAC: Authorizing `identity:get_user(user_id=dec4bbdc981d49009c65500553fba79f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:33.282845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:33.287504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271510e-fda3-4bcc-9650-c1b53acbfaa3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:33.289575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 162/311] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:33 2022] GET /identity/v3/users/dec4bbdc981d49009c65500553fba79f => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:33.290544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:33.348675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:33.405783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271510e-fda3-4bcc-9650-c1b53acbfaa3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.412754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db66d5-633c-4a61-b37e-6336fcdc5733 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.442080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.443033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.443196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:33.443427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.443770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.455436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:33.456680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.457606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.458061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.458506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.459602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] RBAC: Adding query filter params (role.id=7eb5f88d39ef40edac0c0a3628afa406, user.id=dec4bbdc981d49009c65500553fba79f, scope.system=all) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:33.460463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:33.462185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:33.463983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:33.464938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:33.465758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 150/312] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:33.471593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:33.471955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 163/313] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jun 23 11:18:33 2022] GET /identity/v3/role_assignments?user.id=dec4bbdc981d49009c65500553fba79f&scope.system=all&role.id=7eb5f88d39ef40edac0c0a3628afa406 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:33.593034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3ad1-d2d7-4f54-9a84-532120abc40f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.609068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:33.632846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.633880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.634304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.634746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.635645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:33.636095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:33.637679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:33.647032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 151/314] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:33.653879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:33.761757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f88280-ee88-4f45-9847-af88f0e43c01 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.797493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.798392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.798682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.798954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] PATH_INFO: `/v3/users/a730c807f35a490bbfdb8c0256801c43` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.800160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] RBAC: Authorizing `identity:get_user(user_id=a730c807f35a490bbfdb8c0256801c43)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:33.801629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:33.803274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 164/315] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:33 2022] GET /identity/v3/users/a730c807f35a490bbfdb8c0256801c43 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:33.808869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:33.910743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0af6cc-1748-4086-b6fe-913c4ca9efbe None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:33.946248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:33.947348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:33.947842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:33.948335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:33.992629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:34.018074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:34.019539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:34.118928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 152/316] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:34.124200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:34.186035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:34.232497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac436ec6-6043-405f-bc67-81a996371987 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:34.269421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af0cf0-7ec2-4a3c-bbdc-63a1f57e4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:34.270218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0cf0-7ec2-4a3c-bbdc-63a1f57e4572 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:34.270499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0cf0-7ec2-4a3c-bbdc-63a1f57e4572 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:34.270773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af0cf0-7ec2-4a3c-bbdc-63a1f57e4572 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:34.271966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af0cf0-7ec2-4a3c-bbdc-63a1f57e4572 None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:34.273565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af0cf0-7ec2-4a3c-bbdc-63a1f57e4572 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:34.275582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 165/317] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:34 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:34.281948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:34.364220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:34.393640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671ebb5-2da5-4bc5-b49a-7629de90cbf0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:34.430585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d340-ac2c-4a6b-82a3-3c8998e2c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:34.431255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d340-ac2c-4a6b-82a3-3c8998e2c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:34.431536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d340-ac2c-4a6b-82a3-3c8998e2c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:34.431811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d340-ac2c-4a6b-82a3-3c8998e2c0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:34.432680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70d340-ac2c-4a6b-82a3-3c8998e2c0b0 None admin] RBAC: Adding query filter params (role.id=7eb5f88d39ef40edac0c0a3628afa406, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339, user.id=a730c807f35a490bbfdb8c0256801c43) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:34.433013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70d340-ac2c-4a6b-82a3-3c8998e2c0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:34.434459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70d340-ac2c-4a6b-82a3-3c8998e2c0b0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:34.441293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 153/318] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:18:34 2022] GET /identity/v3/role_assignments?user.id=a730c807f35a490bbfdb8c0256801c43&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=7eb5f88d39ef40edac0c0a3628afa406 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:34.724610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840ce4-264a-4aa9-a6b6-052e756af230 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:34.725058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840ce4-264a-4aa9-a6b6-052e756af230 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:34.725226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840ce4-264a-4aa9-a6b6-052e756af230 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:34.727093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 166/319] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:34.732936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5124-78aa-48f9-9579-14eec440528c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:34.733302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5124-78aa-48f9-9579-14eec440528c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:34.733642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f5124-78aa-48f9-9579-14eec440528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:34.751678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-237f5124-78aa-48f9-9579-14eec440528c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:34.752914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-237f5124-78aa-48f9-9579-14eec440528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:34.823475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 154/320] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:34.846848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3840ce4-264a-4aa9-a6b6-052e756af230 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:34.954332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3840ce4-264a-4aa9-a6b6-052e756af230 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:34.977210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:34.990048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:34.990871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:34.991276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:34.991604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.001858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:35.009516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:35.010360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:35.011157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 167/321] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:35.018012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f5124-78aa-48f9-9579-14eec440528c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:35.096948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:35.132180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f5124-78aa-48f9-9579-14eec440528c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:35.167178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481546d-4c82-4dcc-af11-4e1c3835f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:35.167850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481546d-4c82-4dcc-af11-4e1c3835f010 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.168123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481546d-4c82-4dcc-af11-4e1c3835f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.168391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481546d-4c82-4dcc-af11-4e1c3835f010 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.169165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481546d-4c82-4dcc-af11-4e1c3835f010 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:35.169468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481546d-4c82-4dcc-af11-4e1c3835f010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:35.170843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481546d-4c82-4dcc-af11-4e1c3835f010 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:35.179651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 155/322] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:35.184994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:35.288419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26794b-a565-494a-b062-12d2f5cf8fc4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:35.318509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8c19b-67da-4604-bb8b-6c55a0b1d651 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.318795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8c19b-67da-4604-bb8b-6c55a0b1d651 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.319076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8c19b-67da-4604-bb8b-6c55a0b1d651 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.320763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 156/323] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:35.326104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71ee5-af8d-4287-9452-4af3915daded None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.326592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71ee5-af8d-4287-9452-4af3915daded None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.326963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71ee5-af8d-4287-9452-4af3915daded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.327806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:35.328687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.329001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.329267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] PATH_INFO: `/v3/users/9afc8426aa1c4c4b95114553b1de5572` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.330446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] RBAC: Authorizing `identity:get_user(user_id=9afc8426aa1c4c4b95114553b1de5572)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:35.331876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:35.333521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 168/324] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:35 2022] GET /identity/v3/users/9afc8426aa1c4c4b95114553b1de5572 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:35.339538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:35.345570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e4d71ee5-af8d-4287-9452-4af3915daded None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:35.346787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e4d71ee5-af8d-4287-9452-4af3915daded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:35.391924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:35.420049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 157/325] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:35.442710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d71ee5-af8d-4287-9452-4af3915daded None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:35.445225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d15b6-7cfd-4e1e-bd24-c5813e159749 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:35.480612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b23c-0a0b-4150-ad95-3147368d23c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:35.481306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b23c-0a0b-4150-ad95-3147368d23c9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.481590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b23c-0a0b-4150-ad95-3147368d23c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.481869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b23c-0a0b-4150-ad95-3147368d23c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.482703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b23c-0a0b-4150-ad95-3147368d23c9 None admin] RBAC: Adding query filter params (role.id=f99f7537ebc7412399a1a7c5f6add8c1, user.id=9afc8426aa1c4c4b95114553b1de5572, scope.system=all) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:35.483023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b23c-0a0b-4150-ad95-3147368d23c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:35.484521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b23c-0a0b-4150-ad95-3147368d23c9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:35.496768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 169/326] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jun 23 11:18:35 2022] GET /identity/v3/role_assignments?user.id=9afc8426aa1c4c4b95114553b1de5572&scope.system=all&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 510 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:35.504550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:35.551476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d71ee5-af8d-4287-9452-4af3915daded None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:35.590665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:35.591488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.591769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.592047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.593309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:35.594798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:35.596645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 158/327] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:35.598110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2bf2-1599-4595-a902-da0698cd8ebc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.598383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2bf2-1599-4595-a902-da0698cd8ebc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.598655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b2bf2-1599-4595-a902-da0698cd8ebc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.600009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 170/328] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:35.602060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:35.606418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adab4b-1199-443c-b3f9-907e84ef486c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.606781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adab4b-1199-443c-b3f9-907e84ef486c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.607084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adab4b-1199-443c-b3f9-907e84ef486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.625136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-76adab4b-1199-443c-b3f9-907e84ef486c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:35.626404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-76adab4b-1199-443c-b3f9-907e84ef486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:35.703990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 171/329] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:35.717757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629910-6900-475a-8fe0-2079e9222d7f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:35.727143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adab4b-1199-443c-b3f9-907e84ef486c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:35.744440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:35.752579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:35.753282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.753563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.753845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] PATH_INFO: `/v3/groups` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.754536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:35.755976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:35.765778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:35.770198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 159/330] 10.222.0.66 () {60 vars in 1134 bytes} [Thu Jun 23 11:18:35 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:35.831191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adab4b-1199-443c-b3f9-907e84ef486c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:35.868195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:35.869074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.869354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.869627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.881847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:35.889911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:35.890893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:35.891680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 172/331] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:35.897821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:36.004186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b893-04fe-4e8e-bb42-5493f6e83957 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:36.046131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:36.046958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:36.047246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:36.047853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:36.048469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:36.048804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:36.050258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:36.060264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 160/332] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:36.066417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:36.181294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:36.186184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009afa5-39f9-434e-967a-05d4c2c22d03 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:36.227169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2064-708e-4f97-bdea-b43dfc449571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:36.228056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2064-708e-4f97-bdea-b43dfc449571 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:36.228337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2064-708e-4f97-bdea-b43dfc449571 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:36.228602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2064-708e-4f97-bdea-b43dfc449571 None admin] PATH_INFO: `/v3/users/dec4bbdc981d49009c65500553fba79f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:36.229845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf2064-708e-4f97-bdea-b43dfc449571 None admin] RBAC: Authorizing `identity:get_user(user_id=dec4bbdc981d49009c65500553fba79f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:36.231297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf2064-708e-4f97-bdea-b43dfc449571 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:36.233336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 173/333] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:36 2022] GET /identity/v3/users/dec4bbdc981d49009c65500553fba79f => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:36.239129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:36.301682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:36.362883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d773ab-6d3f-4f40-b52d-594adfa04b4b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:36.400536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47ee50-7b7e-4412-a167-a37528592340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:36.401871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ee50-7b7e-4412-a167-a37528592340 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:36.402348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ee50-7b7e-4412-a167-a37528592340 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:36.402816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47ee50-7b7e-4412-a167-a37528592340 None admin] PATH_INFO: `/v3/system/users/dec4bbdc981d49009c65500553fba79f/roles/7eb5f88d39ef40edac0c0a3628afa406` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:36.404575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47ee50-7b7e-4412-a167-a37528592340 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dec4bbdc981d49009c65500553fba79f, role_id=7eb5f88d39ef40edac0c0a3628afa406)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:36.406232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47ee50-7b7e-4412-a167-a37528592340 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:36.420902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 161/334] 10.222.0.66 () {58 vars in 1334 bytes} [Thu Jun 23 11:18:36 2022] PUT /identity/v3/system/users/dec4bbdc981d49009c65500553fba79f/roles/7eb5f88d39ef40edac0c0a3628afa406 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:38.056219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7879-9382-4f5c-a463-8ad78d13f810 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.056867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7879-9382-4f5c-a463-8ad78d13f810 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.056867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a7879-9382-4f5c-a463-8ad78d13f810 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.058510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 174/335] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:38.064054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f0c73-41ef-4f4b-8193-c4071453e206 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.064873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f0c73-41ef-4f4b-8193-c4071453e206 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.065361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f0c73-41ef-4f4b-8193-c4071453e206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.094260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fc0f0c73-41ef-4f4b-8193-c4071453e206 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:38.095837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fc0f0c73-41ef-4f4b-8193-c4071453e206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:38.178059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 162/336] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:38.204791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7879-9382-4f5c-a463-8ad78d13f810 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:38.339185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a7879-9382-4f5c-a463-8ad78d13f810 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:38.392173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922a996-e4d7-4d88-a275-82595efe391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:38.393404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922a996-e4d7-4d88-a275-82595efe391a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.393885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922a996-e4d7-4d88-a275-82595efe391a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.394370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922a996-e4d7-4d88-a275-82595efe391a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.410142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922a996-e4d7-4d88-a275-82595efe391a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b922a996-e4d7-4d88-a275-82595efe391a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:38.418226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:38.419095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:38.419882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:38.422665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 175/337] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:38.433878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f0c73-41ef-4f4b-8193-c4071453e206 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:38.526470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:38.593071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f0c73-41ef-4f4b-8193-c4071453e206 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:38.620797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e540-9ca9-44d3-9b45-6a25bf24f32f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.621316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e540-9ca9-44d3-9b45-6a25bf24f32f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.621762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e540-9ca9-44d3-9b45-6a25bf24f32f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.623631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 176/338] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:38.631144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37c1d-1778-4208-b203-7b897ace2831 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.631632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37c1d-1778-4208-b203-7b897ace2831 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.632041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37c1d-1778-4208-b203-7b897ace2831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.634338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:38.635027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.635310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.635583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.636343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:38.636664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:38.638096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:38.655005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 163/339] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:38.659274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-22e37c1d-1778-4208-b203-7b897ace2831 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:38.660639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:38.660777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-22e37c1d-1778-4208-b203-7b897ace2831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:38.701991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:38.783604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 177/340] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:38.826922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37c1d-1778-4208-b203-7b897ace2831 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:38.890814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9797c0-1a26-4166-94a9-35c105bff53b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:38.905072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:38.985462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a24b2a-ee0c-4ceb-a20a-bcdd1b8febed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:38.986151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24b2a-ee0c-4ceb-a20a-bcdd1b8febed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.986437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24b2a-ee0c-4ceb-a20a-bcdd1b8febed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.986714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a24b2a-ee0c-4ceb-a20a-bcdd1b8febed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.026490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37c1d-1778-4208-b203-7b897ace2831 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.085332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.086170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.086455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.086734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.106983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:39.115359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:39.116359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:39.117172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 178/341] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:39.122683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.130844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a24b2a-ee0c-4ceb-a20a-bcdd1b8febed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.132389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a24b2a-ee0c-4ceb-a20a-bcdd1b8febed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.157202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:39.260171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 164/342] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:18:39.261664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d7a09-f29e-46ff-8d77-b74003213e26 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.261949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d7a09-f29e-46ff-8d77-b74003213e26 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.262229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d7a09-f29e-46ff-8d77-b74003213e26 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.263561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 165/343] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:39.269390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545cf8e-6da8-4705-b8e6-f13c784999c5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.269676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545cf8e-6da8-4705-b8e6-f13c784999c5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.269958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545cf8e-6da8-4705-b8e6-f13c784999c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.279367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f867d-78d2-4c90-bac7-37cb5f55fb2f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.292416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:39.301790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8545cf8e-6da8-4705-b8e6-f13c784999c5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:39.303073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8545cf8e-6da8-4705-b8e6-f13c784999c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:39.317301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.317998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.318286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.318576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.319465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:39.319830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.321310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.330707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 179/344] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:39.331580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.420639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 166/345] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:39.422431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545cf8e-6da8-4705-b8e6-f13c784999c5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.470048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:39.514397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099d80b-c725-4310-b45a-c601fd68d63a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.579639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.580511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.580816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.581096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.582802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.584036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545cf8e-6da8-4705-b8e6-f13c784999c5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.584232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.586543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 180/346] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:39.588144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.627468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745f4ec-cce1-46ef-880e-292641ab8f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.628208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f4ec-cce1-46ef-880e-292641ab8f6c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.628494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f4ec-cce1-46ef-880e-292641ab8f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.628808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745f4ec-cce1-46ef-880e-292641ab8f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.633554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:39.712621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da631967-2f39-422a-adc0-a2fab4529e5c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.713713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745f4ec-cce1-46ef-880e-292641ab8f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.715861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745f4ec-cce1-46ef-880e-292641ab8f6c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.752918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abd007-5375-460e-86a7-c7fcf47caf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.754227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd007-5375-460e-86a7-c7fcf47caf88 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.754227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd007-5375-460e-86a7-c7fcf47caf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.754227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abd007-5375-460e-86a7-c7fcf47caf88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.767188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abd007-5375-460e-86a7-c7fcf47caf88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-52abd007-5375-460e-86a7-c7fcf47caf88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:39.775102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:39.776053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:39.777333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 181/347] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:39.778191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8591672-7d6c-4e51-86c2-d6f888e1fa8d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.778191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8591672-7d6c-4e51-86c2-d6f888e1fa8d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.778191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8591672-7d6c-4e51-86c2-d6f888e1fa8d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.780778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 182/348] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:39.780778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8591672-7d6c-4e51-86c2-d6f888e1fa8d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.790762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:39.857058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 167/349] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:39.858635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96d04-56ff-4e9e-aef1-7f04439a6011 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.859054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96d04-56ff-4e9e-aef1-7f04439a6011 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.863825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb96d04-56ff-4e9e-aef1-7f04439a6011 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.865469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 168/350] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:39.866958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80de8f-f1ed-48d5-9a28-36a73ef44735 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.867242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80de8f-f1ed-48d5-9a28-36a73ef44735 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.867516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80de8f-f1ed-48d5-9a28-36a73ef44735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.889169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ac80de8f-f1ed-48d5-9a28-36a73ef44735 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:39.891467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ac80de8f-f1ed-48d5-9a28-36a73ef44735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:39.920938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8591672-7d6c-4e51-86c2-d6f888e1fa8d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.924980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:39.968902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.969752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.970028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.970339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.973687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 169/351] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:39.974555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80de8f-f1ed-48d5-9a28-36a73ef44735 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.978147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.979640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.982170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 183/352] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:39.985559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.079817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:40.100827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80de8f-f1ed-48d5-9a28-36a73ef44735 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.127968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d205db-4b6e-4265-834a-8f9b7c82a2ee None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.153638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45c41b-8e3a-4ced-9a3a-20c1656eb384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.154153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c41b-8e3a-4ced-9a3a-20c1656eb384 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.154153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c41b-8e3a-4ced-9a3a-20c1656eb384 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.154305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c41b-8e3a-4ced-9a3a-20c1656eb384 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.155018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45c41b-8e3a-4ced-9a3a-20c1656eb384 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:40.156815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45c41b-8e3a-4ced-9a3a-20c1656eb384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:40.157556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc45c41b-8e3a-4ced-9a3a-20c1656eb384 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.168336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 170/353] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:40.169787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d4772-c8eb-4aa9-b2ab-dc27e72b7bcc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.170071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d4772-c8eb-4aa9-b2ab-dc27e72b7bcc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.170239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d4772-c8eb-4aa9-b2ab-dc27e72b7bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.177726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.178836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.179182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.179462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.180763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:40.182195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.184205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 184/354] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:40.185093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.193397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a71d4772-c8eb-4aa9-b2ab-dc27e72b7bcc None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:40.194643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a71d4772-c8eb-4aa9-b2ab-dc27e72b7bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:40.223762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:40.276207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 171/355] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:40.277233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d4772-c8eb-4aa9-b2ab-dc27e72b7bcc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.322567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c136ce-bbbe-49b5-be21-ce6bf73ce3dc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.363998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.364872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.365253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.365627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.366714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:40.367032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:40.368501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.375932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 185/356] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:40.376952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.379889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:40.400067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d4772-c8eb-4aa9-b2ab-dc27e72b7bcc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.452778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.453970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.454475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.454948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.469358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:40.478076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:40.478984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:40.479765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 172/357] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:40.480447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.508022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:40.532621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36069-810d-424c-9056-7c2a3c2a838f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.579197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15203709-3677-43dd-8aa4-9c98fc47ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.579886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15203709-3677-43dd-8aa4-9c98fc47ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.580162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15203709-3677-43dd-8aa4-9c98fc47ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.580431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15203709-3677-43dd-8aa4-9c98fc47ddb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.601210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bd62a-f614-434f-b76f-79785e5f9a74 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.657109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.657955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.658472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.658595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.660075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:40.661575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.663486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 173/358] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:40.664087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.670533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15203709-3677-43dd-8aa4-9c98fc47ddb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:40.672304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15203709-3677-43dd-8aa4-9c98fc47ddb1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.674444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:40.777796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:40.795852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3079c-0454-4625-9a9c-8c3750e11ec2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.798712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 186/359] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:40.800250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bc3e0-a551-473b-8e55-680e4b23ef2a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.800534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bc3e0-a551-473b-8e55-680e4b23ef2a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.800852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bc3e0-a551-473b-8e55-680e4b23ef2a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.802258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 187/360] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:40.806885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bc3e0-a551-473b-8e55-680e4b23ef2a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.846239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.847075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.847355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.847628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.862249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:40.870711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:40.871907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 174/361] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:40.872937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.935951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bc3e0-a551-473b-8e55-680e4b23ef2a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.939176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:40.977448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.978123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.978412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.978810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.979495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:40.980223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:40.984966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.994150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 188/362] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:40.995093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.006465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01eff1-58b6-4f01-a353-e97928b05bb2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.054469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902eb0-6839-401d-b137-816bfff08664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.057429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902eb0-6839-401d-b137-816bfff08664 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.057429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902eb0-6839-401d-b137-816bfff08664 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.057429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902eb0-6839-401d-b137-816bfff08664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.057429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69902eb0-6839-401d-b137-816bfff08664 None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:41.057429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69902eb0-6839-401d-b137-816bfff08664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:41.058227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69902eb0-6839-401d-b137-816bfff08664 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:41.068940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 175/363] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:41.070572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285c7b3-c869-430a-8f82-26a6165796bc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.070859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285c7b3-c869-430a-8f82-26a6165796bc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.071138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285c7b3-c869-430a-8f82-26a6165796bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.110220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b285c7b3-c869-430a-8f82-26a6165796bc None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:41.111857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b285c7b3-c869-430a-8f82-26a6165796bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:41.117512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:41.139496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b578e8-d4ab-4061-bb9a-5638616c168e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.188509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.189896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.190376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.191204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.192689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:41.195067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:41.197169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 189/364] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:41.198157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.226794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 176/365] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:41.227751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285c7b3-c869-430a-8f82-26a6165796bc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.252479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:41.362829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b68b8-16da-4fbf-9213-1b6b86c86d2c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.375071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285c7b3-c869-430a-8f82-26a6165796bc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.410333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.411042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.411459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.411756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.414298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:41.414298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:41.415157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:41.423571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.425098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.425540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.425953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] PATH_INFO: `/v3/users/dec4bbdc981d49009c65500553fba79f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.426205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 190/366] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:41.430846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.431818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] RBAC: Authorizing `identity:get_user(user_id=dec4bbdc981d49009c65500553fba79f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:41.434921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:41.437038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 177/367] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:18:41 2022] GET /identity/v3/users/dec4bbdc981d49009c65500553fba79f => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:41.437977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.456147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:41.570664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:41.579491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d7885-93e7-476b-bb14-d0e1530dad8f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.595640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce8525-d577-4aa2-bf01-8f6a7bbe17b3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.625041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.625929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.626278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.626641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.627890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:41.629498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:41.636113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 191/368] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:41 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:41.637025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.641821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.642911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.643390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.643846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.656229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:41.665284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:41.666168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:41.666947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:41.669835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 178/369] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:41.670865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.744912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237bd07-ea8c-4309-8bdc-b28b807c7274 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.747896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:41.783611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.784304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.784636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.785010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.785807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9df348-4892-4e81-8a2c-40ff8c9970af None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:41.818406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:41.829474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:41.830156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:41.830460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:41.831177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:41.832034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] RBAC: Adding query filter params (role.id=7eb5f88d39ef40edac0c0a3628afa406, user.id=dec4bbdc981d49009c65500553fba79f, scope.system=all) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:41.832355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:41.834206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:41.849784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 179/370] 10.222.0.66 () {56 vars in 1308 bytes} [Thu Jun 23 11:18:41 2022] GET /identity/v3/role_assignments?user.id=dec4bbdc981d49009c65500553fba79f&scope.system=all&role.id=7eb5f88d39ef40edac0c0a3628afa406 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:41.850892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:41.877165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:41.879274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.038662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed245c-e900-4c73-af67-6b1a996d3885 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.039553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 192/371] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:42.040469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.119190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:42.136493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.137120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.137406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.137683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.138527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:42.138842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:42.140286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.146650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:42.148452 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 180/372] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:41 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 260 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:42.150371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.227621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532fb9b-205b-4319-b57e-0a2d8c1d922e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.276168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a177d-3a72-43f5-a067-cd64e3b305c5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.299014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.299703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.299985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.300261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.301058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:42.301365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:42.302761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.318767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 193/373] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:42.327564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.355638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.356531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.356831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.357105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.359135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:42.360625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.362445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 181/374] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:42.370481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.481100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:42.531163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6b360-c240-48ec-ac07-e34b834ce0a3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.543016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf868e9-0081-487c-be3a-6f24bc86ddb2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.580966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:42.601628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.602623 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.603084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.603549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.618158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.619497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.619988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.620488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.624157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:42.625858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.627724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 182/375] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:42.633813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.712761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:42.714506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.766007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276e9af-c463-4328-a604-f94841fb8fd5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.801570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:42.812680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b0ff-fb7e-43ea-ba70-c2c89334ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.813948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b0ff-fb7e-43ea-ba70-c2c89334ace5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.814683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b0ff-fb7e-43ea-ba70-c2c89334ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.814851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b0ff-fb7e-43ea-ba70-c2c89334ace5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.816317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b0ff-fb7e-43ea-ba70-c2c89334ace5 None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:42.816753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b0ff-fb7e-43ea-ba70-c2c89334ace5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:42.819295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b0ff-fb7e-43ea-ba70-c2c89334ace5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.826962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 183/376] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:42.828855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bf56-c933-4d52-895d-8fe6aaaaec35 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.829250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bf56-c933-4d52-895d-8fe6aaaaec35 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.829633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bf56-c933-4d52-895d-8fe6aaaaec35 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.832166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 184/377] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:42.838924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20dc58-bb66-48d7-b599-f1be7a3d394a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.838924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20dc58-bb66-48d7-b599-f1be7a3d394a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.839255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20dc58-bb66-48d7-b599-f1be7a3d394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.843466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 194/378] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:42.852690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.866224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-af20dc58-bb66-48d7-b599-f1be7a3d394a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:42.868455 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-af20dc58-bb66-48d7-b599-f1be7a3d394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:42.886985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:42.981449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488bfe4-c2b1-4c2c-ab48-a018df1d8140 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.984406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 185/379] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:43.019693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.020416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.020700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.020998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] PATH_INFO: `/v3/projects/e7142c8080614c18a4273bc9286ea762` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.021733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20dc58-bb66-48d7-b599-f1be7a3d394a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.022275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] RBAC: Authorizing `identity:get_project(project_id=e7142c8080614c18a4273bc9286ea762)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.023712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.026241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 195/380] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/projects/e7142c8080614c18a4273bc9286ea762 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:43.033205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.142149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:43.153493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc785-63e1-4512-9700-19cfb8dcafcc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:43.203354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.204241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.204529 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.204833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] PATH_INFO: `/v3/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.210125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] RBAC: Authorizing `identity:get_group(group_id=7ffbdf6e0bca4cd4b9afb84c9abebc44)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.211565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.213650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 196/381] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:43 2022] GET /identity/v3/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:43.221418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.265801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20dc58-bb66-48d7-b599-f1be7a3d394a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:43.302681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:43.331884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.332729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.333014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.333282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.345778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:43.354014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:43.354888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:43.355673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 186/382] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:43.362674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.414238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020481d-f2a3-4506-a474-d0c54f2ea6cc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:43.455039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.455722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.456064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.456345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.460765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] RBAC: Adding query filter params (group.id=7ffbdf6e0bca4cd4b9afb84c9abebc44, role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=e7142c8080614c18a4273bc9286ea762) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:43.460765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.460765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.465270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 197/383] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:43 2022] GET /identity/v3/role_assignments?group.id=7ffbdf6e0bca4cd4b9afb84c9abebc44&scope.project.id=e7142c8080614c18a4273bc9286ea762&role.id=2072cf36ca344da697b097313f411f3b => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:43.500254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e95e-a815-41a8-b586-076d1ff2c6be None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:43.555399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5106de0-c400-45ae-a158-07f97389bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.556015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106de0-c400-45ae-a158-07f97389bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.556297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106de0-c400-45ae-a158-07f97389bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.556572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5106de0-c400-45ae-a158-07f97389bd94 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.557371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5106de0-c400-45ae-a158-07f97389bd94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:43.557685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5106de0-c400-45ae-a158-07f97389bd94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.559134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5106de0-c400-45ae-a158-07f97389bd94 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.572928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 187/384] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:43.578610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.607227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:43.626725 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8acae-f403-4185-b636-34850d2e7602 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.627075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8acae-f403-4185-b636-34850d2e7602 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.627283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8acae-f403-4185-b636-34850d2e7602 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.628773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 188/385] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:43.646410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7be9d-5b2b-4022-90f4-959b18606a91 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.646711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7be9d-5b2b-4022-90f4-959b18606a91 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.647074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7be9d-5b2b-4022-90f4-959b18606a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.682386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-11d7be9d-5b2b-4022-90f4-959b18606a91 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:43.683609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-11d7be9d-5b2b-4022-90f4-959b18606a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:43.707630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8abe-a37a-4eec-a827-228898d5952c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:43.744941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.745833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.746112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.746384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.747898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.749517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.755800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 198/386] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:43 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:43.757260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.792260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:43.857170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:43.869703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76538519-ac45-4f1b-8fbc-d163ca9c5c16 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:43.870462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 189/387] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:43.904759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.905965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.906136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7be9d-5b2b-4022-90f4-959b18606a91 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.906584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.907022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.908517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.910229 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.916400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 199/388] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:43 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:43.918849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.095573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c142a-09b5-47d1-8788-7c55c6679c80 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.104344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7be9d-5b2b-4022-90f4-959b18606a91 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.140410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.141556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.142012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.142482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.155006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:44.163513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:44.164372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:44.165177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:44.167920 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 190/389] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:44.174701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.209746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.210688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.210972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.211248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.215583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] RBAC: Authorizing `identity:create_grant(project_id=1dd5a2a2262d43ccbc624cf96e1b6180, group_id=1b0a8d7c613f493ea637c848dfef6c06, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:44.217059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:44.228397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:44.243292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 200/390] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jun 23 11:18:43 2022] PUT /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:44.312107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ee5c3-fdd7-4a18-95cb-deee72654f9e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.349475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.350522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.350899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.351179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.352111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:44.352424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:44.353890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:44.364110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 191/391] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:44.370040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.425334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:44.507136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d3f27-3c39-4b03-88dc-086180e303eb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.542209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36da3d4-7185-44a4-996f-53d59a0795ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.543448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36da3d4-7185-44a4-996f-53d59a0795ba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.543924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36da3d4-7185-44a4-996f-53d59a0795ba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.544389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36da3d4-7185-44a4-996f-53d59a0795ba None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.545808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36da3d4-7185-44a4-996f-53d59a0795ba None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:44.547467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36da3d4-7185-44a4-996f-53d59a0795ba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:44.549717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 201/392] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:44 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:44.555792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.670241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:44.683739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223c79b-fc9f-4cee-8ef9-029c5449b639 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.690156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914d3d-6f14-43d7-b3b1-367f24728d67 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.690837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914d3d-6f14-43d7-b3b1-367f24728d67 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.691117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914d3d-6f14-43d7-b3b1-367f24728d67 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.695052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 202/393] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:44.706748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43bd8-3988-4457-a6dd-01ae88872e08 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.707167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43bd8-3988-4457-a6dd-01ae88872e08 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.707570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca43bd8-3988-4457-a6dd-01ae88872e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.718809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.719694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.719977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.720254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.721470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:44.722948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:44.725439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 192/394] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:44 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:44.731104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.740117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6ca43bd8-3988-4457-a6dd-01ae88872e08 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:44.741523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6ca43bd8-3988-4457-a6dd-01ae88872e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:44.837309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 203/395] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:44.869745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca43bd8-3988-4457-a6dd-01ae88872e08 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.887348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98dee-0826-4e79-9777-5850ba780724 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.893432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:44.925841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.927103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.927577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.928192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.930730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] RBAC: Authorizing `identity:create_grant(project_id=1dd5a2a2262d43ccbc624cf96e1b6180, group_id=1b0a8d7c613f493ea637c848dfef6c06, role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:44.932355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:44.962282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 193/396] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jun 23 11:18:44 2022] PUT /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:45.019938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca43bd8-3988-4457-a6dd-01ae88872e08 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.077424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.078616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.079046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.079461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.104924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:45.119726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:45.120671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:45.121497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 204/397] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:45.127398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.172614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:45.256710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eb79c-34cd-4b9c-a46a-594bdbb7249c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.290850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.291873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.292367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.292878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.293831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:45.294336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.295891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.304473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 194/398] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:45.313831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.413721 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:45.455341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d3521-2e26-4811-965c-b6a385cfda5c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.502390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733aaf2-eff0-4a28-9262-71dd82bc1b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.503268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733aaf2-eff0-4a28-9262-71dd82bc1b0b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.503553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733aaf2-eff0-4a28-9262-71dd82bc1b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.503826 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733aaf2-eff0-4a28-9262-71dd82bc1b0b None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.505116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733aaf2-eff0-4a28-9262-71dd82bc1b0b None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.506989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733aaf2-eff0-4a28-9262-71dd82bc1b0b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.508209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 205/399] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:45.517828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.522317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213346-90d5-40dd-89bc-57a54e920b55 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.522665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213346-90d5-40dd-89bc-57a54e920b55 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.522891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213346-90d5-40dd-89bc-57a54e920b55 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.524333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 206/400] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:45.534503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ae1c8-8039-4103-bd19-0561d701994c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.534790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ae1c8-8039-4103-bd19-0561d701994c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.535070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ae1c8-8039-4103-bd19-0561d701994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.566679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-393ae1c8-8039-4103-bd19-0561d701994c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:45.571356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-393ae1c8-8039-4103-bd19-0561d701994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:45.637125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:45.650618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937689a-73e9-4cee-8e0c-8b67f186b6f3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.686427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.687753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.688243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.688709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.690127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.692130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.694580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 195/401] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:45.704841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.728875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 207/402] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:45.753751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ae1c8-8039-4103-bd19-0561d701994c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.857773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:45.886657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ae1c8-8039-4103-bd19-0561d701994c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.921467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.922294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.922576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.922851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.933934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:45.942739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:45.943706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:45.944568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 208/403] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:45.951617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.958662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e0936-b08f-4c66-8b07-c524151a015f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.028492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda3970-cb12-4806-8e4f-4c6950f1f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.029947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda3970-cb12-4806-8e4f-4c6950f1f09f None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.031582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda3970-cb12-4806-8e4f-4c6950f1f09f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.032639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda3970-cb12-4806-8e4f-4c6950f1f09f None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.035720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda3970-cb12-4806-8e4f-4c6950f1f09f None admin] RBAC: Authorizing `identity:create_grant(project_id=a8342a1f31e1493b90b3d0f5807a1339, group_id=1b0a8d7c613f493ea637c848dfef6c06, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.037627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda3970-cb12-4806-8e4f-4c6950f1f09f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.066328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 196/404] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jun 23 11:18:45 2022] PUT /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:46.096451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d325ef-d40d-4a6e-9301-9893a8c79db1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.134486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ec67-4e23-47ae-88f1-af5c50b22641 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.134727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ec67-4e23-47ae-88f1-af5c50b22641 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.134957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ec67-4e23-47ae-88f1-af5c50b22641 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.136535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 197/405] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:46.143309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017dc8-9784-4c1b-9614-5029b7ad514f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.143662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017dc8-9784-4c1b-9614-5029b7ad514f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.143866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017dc8-9784-4c1b-9614-5029b7ad514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.145850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:46.158909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.159972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.160479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.161001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.161967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:46.162510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.164134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.175895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c8017dc8-9784-4c1b-9614-5029b7ad514f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:46.179800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c8017dc8-9784-4c1b-9614-5029b7ad514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:46.182988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 209/406] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:46.191876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.200250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:46.282181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 198/407] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:46.306473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8017dc8-9784-4c1b-9614-5029b7ad514f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.350058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287e9ee-2f5f-4afd-aa8d-572452860285 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.414261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.415058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.415343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.415627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.417580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.419028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.420693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 210/408] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:46 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:46.426419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.476769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8017dc8-9784-4c1b-9614-5029b7ad514f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.517663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:46.563372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941207f-91ba-4e4f-87ec-c395513f2f95 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.581456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.582284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.582570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.582847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.605411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.606315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.607618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.607899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.610311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.611751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.617602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:46.623997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 211/409] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:46 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:46.624862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:46.639669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:46.640574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:46.641398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:46.642871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 199/410] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:46.665835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.670453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:46.777576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383e102-47ee-45b9-8a3d-f953d0ef71ef None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.811170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8d442-f044-4781-b8df-606b45d41b12 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.814020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:46.824769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.824769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.824769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.824769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.825265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8342a1f31e1493b90b3d0f5807a1339, group_id=1b0a8d7c613f493ea637c848dfef6c06, role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.827041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.846368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 212/411] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jun 23 11:18:46 2022] PUT /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339/groups/1b0a8d7c613f493ea637c848dfef6c06/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:46.872039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851b350-2453-4d1f-a04d-8f514d829d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.873170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851b350-2453-4d1f-a04d-8f514d829d19 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.873630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851b350-2453-4d1f-a04d-8f514d829d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.874076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851b350-2453-4d1f-a04d-8f514d829d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.875050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851b350-2453-4d1f-a04d-8f514d829d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:46.875530 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851b350-2453-4d1f-a04d-8f514d829d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.877312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851b350-2453-4d1f-a04d-8f514d829d19 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.888136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 200/412] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:46.893592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.023594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebf46f-95e3-43b1-b5ab-edf9e5340812 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.035898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d8fd-d54a-499a-9868-bb78be277b5c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.036267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d8fd-d54a-499a-9868-bb78be277b5c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.036616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44d8fd-d54a-499a-9868-bb78be277b5c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.039162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 201/413] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:47.049334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38249e-d926-40fe-a548-4abb27a0077c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.049665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38249e-d926-40fe-a548-4abb27a0077c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.049887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38249e-d926-40fe-a548-4abb27a0077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.087211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:47.088767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.089708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.090503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] PATH_INFO: `/v3/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.092605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffbdf6e0bca4cd4b9afb84c9abebc44)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:47.094362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:47.096564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 213/414] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:46 2022] GET /identity/v3/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:47.102472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.102727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bd38249e-d926-40fe-a548-4abb27a0077c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:47.104535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bd38249e-d926-40fe-a548-4abb27a0077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:47.171604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:47.197863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:47.199423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 202/415] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:47.225931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38249e-d926-40fe-a548-4abb27a0077c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.256589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fd1f5-774e-4edd-ac40-b7205c154d87 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.324781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:47.325672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.326012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.326342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] PATH_INFO: `/v3/projects/e7142c8080614c18a4273bc9286ea762` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.327596 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] RBAC: Authorizing `identity:get_project(project_id=e7142c8080614c18a4273bc9286ea762)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:47.329113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:47.331170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 214/416] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:47 2022] GET /identity/v3/projects/e7142c8080614c18a4273bc9286ea762 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:47.337175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.380453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38249e-d926-40fe-a548-4abb27a0077c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.435994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da11267-aa72-4d43-8b7d-0d9d39c1b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:47.437136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11267-aa72-4d43-8b7d-0d9d39c1b400 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.437553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11267-aa72-4d43-8b7d-0d9d39c1b400 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.437979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da11267-aa72-4d43-8b7d-0d9d39c1b400 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.463186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da11267-aa72-4d43-8b7d-0d9d39c1b400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:47.468547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801a40d-d5d2-499b-a1a1-e8b77e95533a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2da11267-aa72-4d43-8b7d-0d9d39c1b400 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:47.481336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:47.482322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:47.483117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:47.487394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 203/417] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:47.487394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced9ce-d627-44d3-bae7-802577f2272d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.487394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced9ce-d627-44d3-bae7-802577f2272d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.487394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced9ce-d627-44d3-bae7-802577f2272d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.488754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 204/418] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:47.489580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced9ce-d627-44d3-bae7-802577f2272d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.509198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:47.520415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527bc28-7998-4eb2-9e08-36b5f48ad683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:47.521668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bc28-7998-4eb2-9e08-36b5f48ad683 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.522123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bc28-7998-4eb2-9e08-36b5f48ad683 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.522694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527bc28-7998-4eb2-9e08-36b5f48ad683 None admin] PATH_INFO: `/v3/projects/e7142c8080614c18a4273bc9286ea762/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.524933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527bc28-7998-4eb2-9e08-36b5f48ad683 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7142c8080614c18a4273bc9286ea762, group_id=7ffbdf6e0bca4cd4b9afb84c9abebc44, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:47.526833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527bc28-7998-4eb2-9e08-36b5f48ad683 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:47.543142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 215/419] 10.222.0.66 () {58 vars in 1442 bytes} [Thu Jun 23 11:18:47 2022] PUT /identity/v3/projects/e7142c8080614c18a4273bc9286ea762/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:47.545206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324aaf-2d03-4202-8770-a040302cbc7c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.545647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324aaf-2d03-4202-8770-a040302cbc7c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.546551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d324aaf-2d03-4202-8770-a040302cbc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.565517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:47.570584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6d324aaf-2d03-4202-8770-a040302cbc7c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:47.572709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6d324aaf-2d03-4202-8770-a040302cbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:47.629304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced9ce-d627-44d3-bae7-802577f2272d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.668820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:47.669851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.670380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.670835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.671775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:47.672262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:47.673973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:47.684828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 205/420] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:47.690962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.730237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 216/421] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:47.755103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d324aaf-2d03-4202-8770-a040302cbc7c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.833436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41b875-6836-4e9f-b624-2c9a510667e7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.853717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:47.878787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:47.879536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.879758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.880034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.966656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:47.967075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d324aaf-2d03-4202-8770-a040302cbc7c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.968147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:48.011591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:48.072658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:48.073711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.074057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.074361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.087133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 206/422] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:48.092968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:48.105670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:48.113512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:48.122142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:48.123056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:48.123821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 217/423] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:48.137816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:48.276028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05856b-f1dd-477d-85be-8e1f0cdd0e61 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:48.281842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b4e9-44a1-4c2b-b583-54bed2aff4d0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:48.340874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:48.341874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.342071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.342323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.344653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:48.346202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:48.349983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 207/424] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:48 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:48.357638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:48.357836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:48.359265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.359920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.360595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.361711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:48.362205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:48.363786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:48.382906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 218/425] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:48.398649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:48.459626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:48.471592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316cfa2-a084-4bb1-9b0a-e4501768fa2f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:48.505322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:48.508209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:48.509998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.510469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.510929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.512290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:48.513996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:48.515814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 208/426] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:48 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:48.521476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:48.624363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7f8f5-ef8d-4d95-89f4-a455a6505a1c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:48.646888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512846f4-c65f-420e-88cb-0b9453b1bffd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:48.666164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc296e60-df3e-44ee-8db1-32acad0e6cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:48.666759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296e60-df3e-44ee-8db1-32acad0e6cce None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.667037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296e60-df3e-44ee-8db1-32acad0e6cce None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.667313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc296e60-df3e-44ee-8db1-32acad0e6cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.668148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc296e60-df3e-44ee-8db1-32acad0e6cce None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:48.668459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc296e60-df3e-44ee-8db1-32acad0e6cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:48.669937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc296e60-df3e-44ee-8db1-32acad0e6cce None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:48.680413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 209/427] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:48 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:48.718271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:48.719039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.719226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21c41-2c97-45ba-bea3-82f610a576df None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.719323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.719510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21c41-2c97-45ba-bea3-82f610a576df None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.719618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.719780 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21c41-2c97-45ba-bea3-82f610a576df None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.722966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 210/428] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:48.731158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154ca79-842e-41cd-94ae-a6243a0b37ca None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:48.731457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154ca79-842e-41cd-94ae-a6243a0b37ca None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:48.731681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154ca79-842e-41cd-94ae-a6243a0b37ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:48.764979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b154ca79-842e-41cd-94ae-a6243a0b37ca None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:48.766274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b154ca79-842e-41cd-94ae-a6243a0b37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:48.794531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:48.796067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:48.809742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:48.869297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 211/429] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:48.882510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:48.901742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154ca79-842e-41cd-94ae-a6243a0b37ca None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:48.964503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 219/430] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:48.969929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.036668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154ca79-842e-41cd-94ae-a6243a0b37ca None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.096659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.098290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.098720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.099388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.107961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a478-d9d1-433c-962c-a7291e2f7cb0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.113769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:49.124214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:49.125728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 11:18:49.126741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:49.129687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 212/431] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:49.136066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.146503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:49.163263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.164179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.164454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.164742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] PATH_INFO: `/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.166720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] RBAC: Authorizing `identity:get_project(project_id=1dd5a2a2262d43ccbc624cf96e1b6180)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:49.168393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:49.170474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 220/432] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:48 2022] GET /identity/v3/projects/1dd5a2a2262d43ccbc624cf96e1b6180 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:49.178067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.189726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:49.277424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4a773-b26f-4ac0-b346-c9eac5b6a14e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.305829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf2513-3f91-4d39-a120-37c2513788c6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.330414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.331102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.331385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.331658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.332436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:49.332757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:49.334386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:49.346568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 213/433] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:49.356673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.358756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.359809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.360224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.360667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.362338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:49.363961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:49.367886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 221/434] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:49.373457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.439125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:49.475981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:49.482222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdf35f-e7c9-4cbf-9ba1-abc75bb6c6b1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.510685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce653b1f-2d48-40eb-b0d8-0019507384db None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.528174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.529175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.529462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.529744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.553176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3951b5-94d7-4bd7-b782-eccf85ee93cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.554552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3951b5-94d7-4bd7-b782-eccf85ee93cf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.555096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3951b5-94d7-4bd7-b782-eccf85ee93cf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.555503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3951b5-94d7-4bd7-b782-eccf85ee93cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.556467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3951b5-94d7-4bd7-b782-eccf85ee93cf None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:49.557042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3951b5-94d7-4bd7-b782-eccf85ee93cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:49.558708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3951b5-94d7-4bd7-b782-eccf85ee93cf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:49.568150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 222/435] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=1dd5a2a2262d43ccbc624cf96e1b6180&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:49.569530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908fa7d-571d-4223-971d-c1338c3186b7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.569818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908fa7d-571d-4223-971d-c1338c3186b7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.570097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908fa7d-571d-4223-971d-c1338c3186b7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.575228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 223/436] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:49.577218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e777b-c3ef-47ad-8fea-4518c879aaa7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.577570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e777b-c3ef-47ad-8fea-4518c879aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.577912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e777b-c3ef-47ad-8fea-4518c879aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.597660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7f0e777b-c3ef-47ad-8fea-4518c879aaa7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:49.599084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7f0e777b-c3ef-47ad-8fea-4518c879aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:49.611451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:49.613459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:49.689490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 224/437] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:49.694493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:49.714333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e777b-c3ef-47ad-8fea-4518c879aaa7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.737763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 214/438] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:49.744792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.799505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:49.854369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e777b-c3ef-47ad-8fea-4518c879aaa7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.857870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d2b81-2b6f-4dc3-a4a8-effff7a38fdd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.895853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.896857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.897139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.897514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.897631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.898695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.899137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.899419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.901243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:49.902705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:49.906593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 215/439] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:49.910474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.910874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:49.921656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:49.922586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:49.923363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 225/440] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:49.929005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.952506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.038923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ce3b9-7628-4601-a561-bef62fd00d2d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.050337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c9be3-29e1-4ccb-825c-73a0d9384849 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.081304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.082704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245263f8-e582-4e4e-8fab-be9eec228554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.083583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245263f8-e582-4e4e-8fab-be9eec228554 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.083896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245263f8-e582-4e4e-8fab-be9eec228554 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.084445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245263f8-e582-4e4e-8fab-be9eec228554 None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.085613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245263f8-e582-4e4e-8fab-be9eec228554 None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.087069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245263f8-e582-4e4e-8fab-be9eec228554 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.088772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 216/441] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:50.089916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57cc9-7c29-4699-b56f-3664691ed689 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.090197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57cc9-7c29-4699-b56f-3664691ed689 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.090473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57cc9-7c29-4699-b56f-3664691ed689 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.091667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 217/442] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:50.094735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee849b1-e502-4836-aea0-5474515d9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.095414 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee849b1-e502-4836-aea0-5474515d9539 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.095833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee849b1-e502-4836-aea0-5474515d9539 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.096111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee849b1-e502-4836-aea0-5474515d9539 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.096458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb57cc9-7c29-4699-b56f-3664691ed689 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.096920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee849b1-e502-4836-aea0-5474515d9539 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:50.097234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee849b1-e502-4836-aea0-5474515d9539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.098608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee849b1-e502-4836-aea0-5474515d9539 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.109028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 226/443] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:50.109028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8485-5dd7-4a16-bc04-27d7b31d02a3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.109028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8485-5dd7-4a16-bc04-27d7b31d02a3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.109028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb8485-5dd7-4a16-bc04-27d7b31d02a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.126458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2edb8485-5dd7-4a16-bc04-27d7b31d02a3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:50.127657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2edb8485-5dd7-4a16-bc04-27d7b31d02a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:50.197300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb57cc9-7c29-4699-b56f-3664691ed689 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.199646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.200484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 227/444] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:50.201400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8485-5dd7-4a16-bc04-27d7b31d02a3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.231845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.232518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.232827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.233103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.233943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=f99f7537ebc7412399a1a7c5f6add8c1, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:50.234248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.235689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.241780 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 218/445] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=f99f7537ebc7412399a1a7c5f6add8c1 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:50.242547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.323141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb8485-5dd7-4a16-bc04-27d7b31d02a3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.348849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.365987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.366665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.366935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.367215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.369849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b77fe3-a6a2-4db2-b6eb-63f1ae9fc847 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.407403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.408231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.408509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.408813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.422433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:50.432560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:50.433567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:50.434375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 219/446] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:50.437725 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.445201 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.446657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.470496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.560410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 228/447] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:50.561773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f135934-ee55-41ad-bd46-0db9d6cdcd3c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.566465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.591737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.603681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.604472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.604887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.605173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.605940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:50.606743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.608170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.617604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 220/448] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:50.622898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.672445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878800f-3d5b-4c5c-a84b-29ee92b7aa81 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.706793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.707673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.707953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.708226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] PATH_INFO: `/v3/projects/a8342a1f31e1493b90b3d0f5807a1339` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.709770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] RBAC: Authorizing `identity:get_project(project_id=a8342a1f31e1493b90b3d0f5807a1339)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.709946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.711228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.712967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 229/449] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/projects/a8342a1f31e1493b90b3d0f5807a1339 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:50.718444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.719835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ab1a-bd33-44d7-956f-bec844f1c841 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.754572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.755237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.755531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.755804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.808606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.822468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d34958-e074-475e-8a34-b3754846a294 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:50.824995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.826476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.856552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:50.857444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:50.857724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:50.857999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] PATH_INFO: `/v3/groups/1b0a8d7c613f493ea637c848dfef6c06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:50.859167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] RBAC: Authorizing `identity:get_group(group_id=1b0a8d7c613f493ea637c848dfef6c06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:50.860625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:50.862345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 230/450] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/groups/1b0a8d7c613f493ea637c848dfef6c06 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:50.868225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.913999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:50.929343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 221/451] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 11:18:50.930345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:50.968651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07ade-a6f9-48f2-aae6-58f4ca542b08 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:51.002813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:51.003485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:51.003758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:51.004006 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:51.004854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] RBAC: Adding query filter params (group.id=1b0a8d7c613f493ea637c848dfef6c06, role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=a8342a1f31e1493b90b3d0f5807a1339) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:51.005161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:51.007230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:51.013460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 231/452] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/role_assignments?group.id=1b0a8d7c613f493ea637c848dfef6c06&scope.project.id=a8342a1f31e1493b90b3d0f5807a1339&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:51.026226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48b11-070c-47b1-94d5-ab46ce74ae50 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:51.066156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:51.067073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:51.067343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:51.067615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] PATH_INFO: `/v3/projects/e7142c8080614c18a4273bc9286ea762` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:51.069218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] RBAC: Authorizing `identity:get_project(project_id=e7142c8080614c18a4273bc9286ea762)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:51.070927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:51.072869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 222/453] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:18:50 2022] GET /identity/v3/projects/e7142c8080614c18a4273bc9286ea762 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:51.078782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:51.105361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:51.188573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf1fce-f636-4e2f-8b4c-07b5861835a4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:51.224266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67b135-02e7-4cea-8373-a773e9ee6ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:51.224960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67b135-02e7-4cea-8373-a773e9ee6ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:51.225241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67b135-02e7-4cea-8373-a773e9ee6ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:51.225517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67b135-02e7-4cea-8373-a773e9ee6ec2 None admin] PATH_INFO: `/v3/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:51.226714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67b135-02e7-4cea-8373-a773e9ee6ec2 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffbdf6e0bca4cd4b9afb84c9abebc44)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:51.228188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67b135-02e7-4cea-8373-a773e9ee6ec2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:51.229854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 232/454] 10.222.0.66 () {56 vars in 1180 bytes} [Thu Jun 23 11:18:51 2022] GET /identity/v3/groups/7ffbdf6e0bca4cd4b9afb84c9abebc44 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:51.235761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:51.294837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:51.336519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c7f0-ad19-43fd-a498-3a0ee5ea1206 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:51.370314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511f0cd-e0cc-472f-a41b-b8ca82897914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:51.371011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f0cd-e0cc-472f-a41b-b8ca82897914 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:51.371265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f0cd-e0cc-472f-a41b-b8ca82897914 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:51.371544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511f0cd-e0cc-472f-a41b-b8ca82897914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:51.372383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511f0cd-e0cc-472f-a41b-b8ca82897914 None admin] RBAC: Adding query filter params (group.id=7ffbdf6e0bca4cd4b9afb84c9abebc44, role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=e7142c8080614c18a4273bc9286ea762) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:51.372808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511f0cd-e0cc-472f-a41b-b8ca82897914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:51.374296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511f0cd-e0cc-472f-a41b-b8ca82897914 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:51.379926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 223/455] 10.222.0.66 () {56 vars in 1376 bytes} [Thu Jun 23 11:18:51 2022] GET /identity/v3/role_assignments?group.id=7ffbdf6e0bca4cd4b9afb84c9abebc44&scope.project.id=e7142c8080614c18a4273bc9286ea762&role.id=2072cf36ca344da697b097313f411f3b => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:53.968295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64622b6b-11c6-46df-84d9-9c930e9be419 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:53.968847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64622b6b-11c6-46df-84d9-9c930e9be419 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:53.968847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64622b6b-11c6-46df-84d9-9c930e9be419 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:53.970464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 233/456] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:53.976169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b227b-59a2-4577-b3cc-b0e434303b48 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:53.976697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b227b-59a2-4577-b3cc-b0e434303b48 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:53.976697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b227b-59a2-4577-b3cc-b0e434303b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.001663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5f7b227b-59a2-4577-b3cc-b0e434303b48 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:54.002878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5f7b227b-59a2-4577-b3cc-b0e434303b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:54.063898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d875-a6e5-4c9b-a093-fc20024a6646 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.064170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d875-a6e5-4c9b-a093-fc20024a6646 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.064448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253d875-a6e5-4c9b-a093-fc20024a6646 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.066347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 234/457] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:54.074304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c186-cc1a-4ea9-ba38-7b978e929a5e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.074591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c186-cc1a-4ea9-ba38-7b978e929a5e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.074870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3c186-cc1a-4ea9-ba38-7b978e929a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.109479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e6b3c186-cc1a-4ea9-ba38-7b978e929a5e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:54.110689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e6b3c186-cc1a-4ea9-ba38-7b978e929a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:54.114634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 224/458] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:54.153552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b227b-59a2-4577-b3cc-b0e434303b48 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.223163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 235/459] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:54.224528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30288a6-9076-419b-bd5e-ba92c11f695a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.224982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30288a6-9076-419b-bd5e-ba92c11f695a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.225604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30288a6-9076-419b-bd5e-ba92c11f695a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.226490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 236/460] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:54.231736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece972-937e-4bf5-b129-5f6a5390601a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.232020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece972-937e-4bf5-b129-5f6a5390601a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.232297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece972-937e-4bf5-b129-5f6a5390601a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.233940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:54.253900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d4ece972-937e-4bf5-b129-5f6a5390601a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:54.255099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d4ece972-937e-4bf5-b129-5f6a5390601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:54.272280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:54.300364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b227b-59a2-4577-b3cc-b0e434303b48 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:54.333288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 237/461] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:54.334714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece972-937e-4bf5-b129-5f6a5390601a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.337642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:54.339847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.340197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.340482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.354933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:54.356456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:54.379753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:54.381045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:54.381989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:54.381989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:54.381989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:54.381989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:54.383867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 225/462] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:54.384847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.458773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece972-937e-4bf5-b129-5f6a5390601a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:54.499833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:54.500984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.501403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.501850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.506516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49160fd0-f1b7-43b4-99e2-9245f230cfcf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:54.508939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:54.514537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:54.516196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:54.525510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:54.536571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:54.537514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:54.538383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:54.538383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:54.538383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:54.538383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:54.541092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 238/463] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:54.542096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.547713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:54.548618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.549030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.549370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.562032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:54.563616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:54.582253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:54.583142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:54.584255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:54.584255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:54.584255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:54.584255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:54.584255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 226/464] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:54.585195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.653866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58510a68-4dbe-4d73-b418-a4c027d0c81d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:54.687143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfae24-7b2b-4fd1-8a4f-160feee8c65c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:54.691280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:54.692184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.692637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.693137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.694160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:54.694656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:54.696203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:54.714358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 239/465] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:54.715674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.723887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:54.724651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.724990 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.725266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.725998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:54.726306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:54.727714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:54.749274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 227/466] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:54.749274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.767159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:54.785539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:54.827705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a16ef8-3a15-42b6-b10d-b15f3406b9fc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:54.851781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931914d-5659-4571-addc-c6ba8c39623a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:54.865207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88be764-189e-4a59-a83c-ab35d6ee6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:54.865983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be764-189e-4a59-a83c-ab35d6ee6aca None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.866269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be764-189e-4a59-a83c-ab35d6ee6aca None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.866781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88be764-189e-4a59-a83c-ab35d6ee6aca None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.867269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88be764-189e-4a59-a83c-ab35d6ee6aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:54.867562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88be764-189e-4a59-a83c-ab35d6ee6aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:54.868971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88be764-189e-4a59-a83c-ab35d6ee6aca None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:54.881671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 240/467] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:54.883013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e94a-981a-4674-a28b-b610488da3c1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.883304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e94a-981a-4674-a28b-b610488da3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.883580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e94a-981a-4674-a28b-b610488da3c1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.888915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 241/468] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:54.888915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e94a-981a-4674-a28b-b610488da3c1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:54.892975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a0d9-8f6e-4e1b-8ebb-efc4d7d1d553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:54.893667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a0d9-8f6e-4e1b-8ebb-efc4d7d1d553 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.893946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a0d9-8f6e-4e1b-8ebb-efc4d7d1d553 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.894220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a0d9-8f6e-4e1b-8ebb-efc4d7d1d553 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.894931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a0d9-8f6e-4e1b-8ebb-efc4d7d1d553 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:54.896436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a0d9-8f6e-4e1b-8ebb-efc4d7d1d553 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:54.917233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 228/469] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:54 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:54.918368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24350fb-f63c-4c8a-ae3e-141ee08c64dc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:54.918659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24350fb-f63c-4c8a-ae3e-141ee08c64dc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:54.918938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24350fb-f63c-4c8a-ae3e-141ee08c64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:54.936815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d24350fb-f63c-4c8a-ae3e-141ee08c64dc None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:54.938059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d24350fb-f63c-4c8a-ae3e-141ee08c64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:55.024306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 229/470] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:55.025183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24350fb-f63c-4c8a-ae3e-141ee08c64dc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:55.027822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:55.058420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e94a-981a-4674-a28b-b610488da3c1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:55.087375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:55.111872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:55.111872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.112132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.112379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.113141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:55.114617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:55.144844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 242/471] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:54 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:55.146258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:55.160551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24350fb-f63c-4c8a-ae3e-141ee08c64dc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:55.202501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677b0bd-5aac-4c53-ae97-156a14d1b98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:55.203203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b0bd-5aac-4c53-ae97-156a14d1b98d None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.203490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b0bd-5aac-4c53-ae97-156a14d1b98d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.203749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677b0bd-5aac-4c53-ae97-156a14d1b98d None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.204485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677b0bd-5aac-4c53-ae97-156a14d1b98d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:55.206992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677b0bd-5aac-4c53-ae97-156a14d1b98d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:55.236563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 230/472] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:55 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:55.316439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0505cb-6be9-4d5c-a0a6-22f543ad29b4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:55.350411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1f5a-4c57-479a-b594-ad61ff168422 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.350411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1f5a-4c57-479a-b594-ad61ff168422 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.350706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d1f5a-4c57-479a-b594-ad61ff168422 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.352109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 231/473] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:55.358355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d2b8b-e001-4ef6-8a68-a61d5626a38b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.358712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d2b8b-e001-4ef6-8a68-a61d5626a38b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.359055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d2b8b-e001-4ef6-8a68-a61d5626a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.371267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:55.372387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.373002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.373277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.379484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-528d2b8b-e001-4ef6-8a68-a61d5626a38b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:55.381919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-528d2b8b-e001-4ef6-8a68-a61d5626a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:55.386465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:55.387938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:55.409024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:55.409911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:55.410785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:55.410785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:55.410785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:55.410785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:55.410785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 243/474] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:55.415114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:55.454960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:55.456692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:55.479800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 232/475] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:55.509465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d2b8b-e001-4ef6-8a68-a61d5626a38b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:55.560416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cff65-5180-48ce-a4b6-4796e5acd1fe None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:55.615771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:55.616559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.616891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.617169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.617927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:55.618235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:55.619768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:55.632893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 244/476] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:55.638321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:55.663706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d2b8b-e001-4ef6-8a68-a61d5626a38b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:55.718083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:55.718817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.719099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.719372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.720185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:55.721728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:55.732751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.sql.core [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 11:18:55.732751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 11:18:55.732751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [parameters: {'id': '786dcc232b914240826f06f38216d1fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 11:18:55.732751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jun 23 11:18:55.750619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:18:55.751729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application yield resource Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise self.value Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application session.commit() Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 11:18:55.757863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.flush() Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application compat.raise_( Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 11:18:55.758690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:18:55.759558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:18:55.760338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [parameters: {'id': '786dcc232b914240826f06f38216d1fc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:55.765231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 11:18:55.767371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:55.769327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 233/477] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jun 23 11:18:55 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:55.769327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:55.785763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:55.812143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31570-785c-4724-b134-fd2edc48ab12 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:55.856320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:55.886911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:55.887956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.888438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.888926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.889841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:55.891479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:55.912855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf0ca9-987c-4c7e-87d3-3118338f805c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:55.927334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 245/478] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:18:55 2022] POST /identity/v3/users => generated 249 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:55.972405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8dd66-9d17-46c6-a04d-57e26205ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:55.973380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8dd66-9d17-46c6-a04d-57e26205ddee None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:55.973663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8dd66-9d17-46c6-a04d-57e26205ddee None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:55.973935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8dd66-9d17-46c6-a04d-57e26205ddee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:55.989917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8dd66-9d17-46c6-a04d-57e26205ddee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c9e8dd66-9d17-46c6-a04d-57e26205ddee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:55.998358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:55.999245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:56.000048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 234/479] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:18:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:56.006737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:56.138974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1788e8-0ac0-4313-ae26-c5071037e254 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:56.174780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6501f-c805-48cd-9d35-e8b72ee0df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:56.175452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6501f-c805-48cd-9d35-e8b72ee0df4a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:56.175735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6501f-c805-48cd-9d35-e8b72ee0df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:56.176001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6501f-c805-48cd-9d35-e8b72ee0df4a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:56.176790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6501f-c805-48cd-9d35-e8b72ee0df4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:56.177099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6501f-c805-48cd-9d35-e8b72ee0df4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:56.179070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6501f-c805-48cd-9d35-e8b72ee0df4a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:56.188007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 246/480] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:18:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:57.541106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1ac4-3e05-40e8-b674-b8f1a9aab5a1 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:57.541624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1ac4-3e05-40e8-b674-b8f1a9aab5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:57.541624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1ac4-3e05-40e8-b674-b8f1a9aab5a1 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:57.543245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 235/481] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:57.548636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3f00a-7302-4ba1-a059-3e8b7c3fb4ad None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:57.549053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3f00a-7302-4ba1-a059-3e8b7c3fb4ad None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:57.549234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3f00a-7302-4ba1-a059-3e8b7c3fb4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:57.564251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:57.573667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6cd3f00a-7302-4ba1-a059-3e8b7c3fb4ad None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:57.574919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6cd3f00a-7302-4ba1-a059-3e8b7c3fb4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:57.670561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 247/482] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:57.705967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b1ac4-3e05-40e8-b674-b8f1a9aab5a1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:57.763463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fb3f6-41c7-4a30-9b3f-c0acfe92116a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:57.764093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fb3f6-41c7-4a30-9b3f-c0acfe92116a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:57.764690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fb3f6-41c7-4a30-9b3f-c0acfe92116a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:57.766612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 248/483] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:18:57.771753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b84683-c852-4c46-8005-27d77cf15113 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:57.772302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b84683-c852-4c46-8005-27d77cf15113 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:57.772797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b84683-c852-4c46-8005-27d77cf15113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:57.790248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-56b84683-c852-4c46-8005-27d77cf15113 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:57.791813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-56b84683-c852-4c46-8005-27d77cf15113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:57.885979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b1ac4-3e05-40e8-b674-b8f1a9aab5a1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:57.887901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 249/484] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:18:57.909589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:57.912324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b84683-c852-4c46-8005-27d77cf15113 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:57.940097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf8feb-36cb-4caf-bed1-ecbc1842bd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:57.940932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8feb-36cb-4caf-bed1-ecbc1842bd7b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:57.941216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8feb-36cb-4caf-bed1-ecbc1842bd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:57.941488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf8feb-36cb-4caf-bed1-ecbc1842bd7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:57.951936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf8feb-36cb-4caf-bed1-ecbc1842bd7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c2bf8feb-36cb-4caf-bed1-ecbc1842bd7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:57.959571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:57.960422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:57.961254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 236/485] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:18:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:57.962403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972713d4-b1be-4805-8515-df7de22a1768 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:57.962746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972713d4-b1be-4805-8515-df7de22a1768 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:57.963022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972713d4-b1be-4805-8515-df7de22a1768 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:57.968460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 237/486] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:57.969289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972713d4-b1be-4805-8515-df7de22a1768 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:57.997124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:58.028884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b84683-c852-4c46-8005-27d77cf15113 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.066392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1607ecc-b089-40fe-881c-8ba528b6cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.067584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1607ecc-b089-40fe-881c-8ba528b6cfcd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.068177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1607ecc-b089-40fe-881c-8ba528b6cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.068755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1607ecc-b089-40fe-881c-8ba528b6cfcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.070913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972713d4-b1be-4805-8515-df7de22a1768 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.080403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1607ecc-b089-40fe-881c-8ba528b6cfcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b1607ecc-b089-40fe-881c-8ba528b6cfcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:58.089028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:58.089947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:58.090726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:58.098130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 250/487] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:18:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:18:58.099893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca830-16c1-422a-968b-6fa83a102dd5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.100375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca830-16c1-422a-968b-6fa83a102dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.100874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca830-16c1-422a-968b-6fa83a102dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.104597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.105306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.105748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.106028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.106779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:58.107091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.108465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.117196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 238/488] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:18:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:58.118002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.122257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c7fca830-16c1-422a-968b-6fa83a102dd5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:58.123519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c7fca830-16c1-422a-968b-6fa83a102dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:58.152231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:58.196738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 251/489] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:58.197700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fca830-16c1-422a-968b-6fa83a102dd5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.243731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2333a1e-0d42-438b-baeb-811b416834d2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.261156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:58.278618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.279300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.279629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.279910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.280663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:58.281002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.282384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.291230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 239/490] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:58.292156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.310715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fca830-16c1-422a-968b-6fa83a102dd5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.353198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.354007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.354288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.354561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.367538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.369531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:58.395019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:58.395995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:58.396948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:58.396948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:58.396948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:58.396948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:58.402811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 252/491] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:58.402811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.419464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:58.426431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3af0c-ee42-4c1e-913f-ecf13990ca51 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.462686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.463866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.464348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.464850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.476065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:58.484234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:58.485136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:58.485946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:58.488339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 240/492] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:58.489483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.521295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bc320-4bcc-4b1d-9765-d3fc2ec5ffcb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.534658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:58.566956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.568607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.569148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.569641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.580508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.582205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:58.602309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:58.603295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:58.604138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:58.604138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:58.604138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:58.604138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:58.604138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 253/493] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:58.604398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.626560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f4136-eaeb-4994-a4b5-f6663823fbc7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.662679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360920c3-7630-4761-bea6-3ddfc6f8b3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.663358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360920c3-7630-4761-bea6-3ddfc6f8b3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.663643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360920c3-7630-4761-bea6-3ddfc6f8b3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.663920 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360920c3-7630-4761-bea6-3ddfc6f8b3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.664645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360920c3-7630-4761-bea6-3ddfc6f8b3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:58.664987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360920c3-7630-4761-bea6-3ddfc6f8b3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.666372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360920c3-7630-4761-bea6-3ddfc6f8b3b6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.679471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 241/494] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:58.684922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32ddb-bfe7-442b-a368-a5d69a6d896c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.685215 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32ddb-bfe7-442b-a368-a5d69a6d896c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.685751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb32ddb-bfe7-442b-a368-a5d69a6d896c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.687467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 242/495] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:58.687991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb32ddb-bfe7-442b-a368-a5d69a6d896c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.710237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:58.719572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817107-3fce-4414-8dc0-144c4ead6ac6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.752075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.752854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.753170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.753485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.754333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:58.754680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.756082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.764077 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 254/496] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:58.764894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.789731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:58.797457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb32ddb-bfe7-442b-a368-a5d69a6d896c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.834090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931e2d9-c9ab-407b-85dd-958eae90deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.834618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e2d9-c9ab-407b-85dd-958eae90deef None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.834903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e2d9-c9ab-407b-85dd-958eae90deef None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.835178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931e2d9-c9ab-407b-85dd-958eae90deef None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.835931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931e2d9-c9ab-407b-85dd-958eae90deef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:58.836235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931e2d9-c9ab-407b-85dd-958eae90deef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.837646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931e2d9-c9ab-407b-85dd-958eae90deef None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.849495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 243/497] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:58.850717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7c61-4df5-4847-80e0-d8f08b835da9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.851000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7c61-4df5-4847-80e0-d8f08b835da9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.851279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d7c61-4df5-4847-80e0-d8f08b835da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.867966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6f6d7c61-4df5-4847-80e0-d8f08b835da9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:58.869178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6f6d7c61-4df5-4847-80e0-d8f08b835da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:58.869571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0dea6-07ee-4ade-83dc-3f77de079f45 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:58.901477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158152ec-c0c4-400d-b287-37eb33fca71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:58.902325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158152ec-c0c4-400d-b287-37eb33fca71a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.902616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158152ec-c0c4-400d-b287-37eb33fca71a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.902891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158152ec-c0c4-400d-b287-37eb33fca71a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.910538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158152ec-c0c4-400d-b287-37eb33fca71a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:58.912169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158152ec-c0c4-400d-b287-37eb33fca71a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-158152ec-c0c4-400d-b287-37eb33fca71a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:18:58.928442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:58.929415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:58.930275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 255/498] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:58.930825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78082a1-5872-46cc-8340-67da2598facb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:58.931455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78082a1-5872-46cc-8340-67da2598facb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:58.931455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78082a1-5872-46cc-8340-67da2598facb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:58.932856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 256/499] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:18:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:18:58.937352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78082a1-5872-46cc-8340-67da2598facb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.940904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 244/500] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:58.942035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7c61-4df5-4847-80e0-d8f08b835da9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:58.950334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.023099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.042178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78082a1-5872-46cc-8340-67da2598facb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.043039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d7c61-4df5-4847-80e0-d8f08b835da9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.076896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a8b41-6f96-4758-8152-630db3f4456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.077716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8b41-6f96-4758-8152-630db3f4456a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.077998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8b41-6f96-4758-8152-630db3f4456a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.078271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8b41-6f96-4758-8152-630db3f4456a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.080646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.081512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.081789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.082062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] PATH_INFO: `/v3/users/glance` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.088865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a8b41-6f96-4758-8152-630db3f4456a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.089326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.090268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a8b41-6f96-4758-8152-630db3f4456a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.090761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:18:59.106417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:59.107293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:59.108190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 245/501] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:59.108786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b47a8b41-6f96-4758-8152-630db3f4456a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:59.108856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:59.109591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:59.110407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:59.110407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:59.110407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:59.110407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:59.110407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 257/502] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:59.111253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13be0-9bc4-4b61-bb6b-a3b47935faf4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.111253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13be0-9bc4-4b61-bb6b-a3b47935faf4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.111549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb13be0-9bc4-4b61-bb6b-a3b47935faf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.128864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eeb13be0-9bc4-4b61-bb6b-a3b47935faf4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:59.130101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eeb13be0-9bc4-4b61-bb6b-a3b47935faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:59.181366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.197922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 258/503] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:18:59.199002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13be0-9bc4-4b61-bb6b-a3b47935faf4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.228554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af513-2f18-4432-af55-415fe4dd43ed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.262170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.263083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.263777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.264049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.264348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.265373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:59.265687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.267193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.302829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb13be0-9bc4-4b61-bb6b-a3b47935faf4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.304689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 246/504] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:59.306541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.340303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.341052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.341332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.341599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.352677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:18:59.361507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:59.362400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:18:59.363182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 259/505] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:59.365176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.414132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ee251-c3d2-45c0-b08d-909ee258c3dd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.438878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.451115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.451782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.452061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.452334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.453212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:59.453524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.454981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.473977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 247/506] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:59.475106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.479284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0c834-f983-4c9f-966f-50b52cb85a36 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.507402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.520842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.523067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.523361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.523634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.524370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:59.524673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.526083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.540439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 260/507] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:59.541303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.592620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9ec6-7f3b-44f3-bc38-59a31e446917 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.633541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.634343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.634624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.634884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.645294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.646959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.647101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878652f2-1c37-4dea-8d0f-6bb3580539e9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:18:59.668487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:18:59.669446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:18:59.670304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:18:59.670304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:18:59.670304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:18:59.670304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:18:59.670304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 248/508] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:18:59.670672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.686710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.687420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.687704 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.687978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.706768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.743769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.761094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.762557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.778381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff23fcf-45be-49ae-99bf-29e75fb4467c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.817176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.817979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.818814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.819097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.819844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:59.820172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:59.821568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:59.830404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 249/509] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:59.831232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.875151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 261/510] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:18:59.876037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:59.942773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.949750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ac7fe-1da4-482f-9ad3-aec0c72db1f7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:59.973437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.986994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:59.987678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:59.987962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:59.988237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:59.997224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78e951-0af7-4afa-b000-ee2d9092395a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.039538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634619af-962d-4027-81ff-7447775078e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.040356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634619af-962d-4027-81ff-7447775078e0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.040638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634619af-962d-4027-81ff-7447775078e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.040932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634619af-962d-4027-81ff-7447775078e0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.049222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634619af-962d-4027-81ff-7447775078e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.051139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634619af-962d-4027-81ff-7447775078e0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.067414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.069403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-634619af-962d-4027-81ff-7447775078e0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:00.071055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:00.071952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:00.072879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:00.073390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 262/511] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:00.074446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634619af-962d-4027-81ff-7447775078e0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.166892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.173961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 250/512] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:18:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:00.174795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.182107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634619af-962d-4027-81ff-7447775078e0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.216758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.217480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.217762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.218032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.218759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:00.219062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.220457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.232085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 263/513] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:00.232923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.236251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.277373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722f538-cf3d-4a6a-aa3d-b1ef0831d3d0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.311218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.312041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.312325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.312605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.323229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.324791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.331545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cf55f-a06e-45ad-91d1-ab351f124ea7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:00.342225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:00.343059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:00.343883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:00.343883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:00.343883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:00.343883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:00.343883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 251/514] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:00.344211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.369795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.370599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.370876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.371148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.381848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.383313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.397742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:00.402976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:00.404023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:00.405204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:00.405204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:00.405204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:00.405204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:00.405204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 264/515] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:00.405204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.467721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342c096-2d7e-47f3-bb17-3926afbd865a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.468398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.503411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.504188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.504384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.504664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.505613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:00.505968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.507616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.513624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78caa2-f960-4be7-bbe8-3e9769e988a1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.525279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 252/516] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:00.526263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.547728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.548520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.548826 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.549097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.560063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.561540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:00.579034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:00.579880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:00.580708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:00.580708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:00.580708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:00.580708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:00.580708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 265/517] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:00.580708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.638120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210d23-b45b-410a-aa63-b89031b27443 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.645365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.673721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.674422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.674702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.674995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.675680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.677162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.684040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e737ebe-13ec-44a3-9a70-38a25f084f17 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.693227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.699024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 253/518] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:19:00 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:00.699841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.725500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.726769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.727385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.727817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.728765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:00.729267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.730841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.744859 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 266/519] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:00.745970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.820117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aa30f-a053-4fd2-8c9f-0fe3086b2336 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.858529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.859200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.859483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.859762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.860499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:00.860837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.862948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.863053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5bd54-7c8c-4624-afa0-037930c9ad77 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:00.876076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 254/520] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:00.877016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:00.903781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.908413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:00.909355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:00.909815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:00.910092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:00.948184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:00.985640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:00.987307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:00.989313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41eba-ef95-4059-96f4-a405ee53e674 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.023964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.024628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.024941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.025212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.025957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:01.026259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.027626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.039317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 255/521] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:01.039953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.101179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 267/522] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:01.106533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.133473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.153008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfd592-724a-475b-9287-2c6b2f04f400 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.180513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.188523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.189366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.190019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.190536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.198387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.199866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:01.214103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:01.215009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:19:01.215888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:01.216400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305315a-ae0e-44fd-bd60-3c486d07a222 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.216472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 256/523] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:01.216472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.255723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.256437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.256741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.257022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.264166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.265667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:01.281336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:01.282187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:01.283148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 268/524] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:01.283628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.330183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee879ad8-0bbf-4518-bb10-d744f21027cf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.366852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.368002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.368419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.368981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.376161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.377646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.387744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c53cff-0eaf-478a-8246-e4539fcdb755 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:01.393072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:01.393893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:01.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 257/525] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:01.395683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.398636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.420261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.430190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.430993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.431277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.432183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.444160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.445664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:01.464002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:01.465114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:01.466142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:01.466142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:01.466142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:01.466142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:01.472001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 269/526] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:01.472001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.511601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4f1e8-3c5f-42c0-a74c-e45be154ede9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.546787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.547458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.547750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.548022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.548893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:01.549228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.550658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.573701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 258/527] 10.222.0.66 () {56 vars in 1139 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:01.574976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac30aed-c027-476d-b09b-8c47a970884c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.579073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.611092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.611743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.612021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.612294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.613251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:01.613432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.614853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.637526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 270/528] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:01.637526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.642632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.682522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.685914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59389f-715f-4675-b3c0-ebe891075d97 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.720335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.721086 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.721368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.721655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.722447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:01.722757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.724272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.747122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 259/529] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:01.747122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.747380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119c54f-c57c-4259-961c-0050de9a2d43 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.782443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.783028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.783310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.783585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.784303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:01.784613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.786376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.797889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 271/530] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:01.798501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:01.857319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd276-f884-4a6b-a3f1-cd64e23710d8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.878435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.894027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.894684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.894962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.895234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.909656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:01.913820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919a60-80e1-493b-a98e-71f3524d91ad None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:01.952547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:01.953251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:01.953523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:01.953792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:01.954616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=bb2aadd5a1204d35a8325b3d56d20b03) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:01.954907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.956336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.969629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:01.971211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:01.973111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 272/531] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/role_assignments?user.id=bb2aadd5a1204d35a8325b3d56d20b03&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:01.980898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.104472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41527e4-e9ef-4cf2-be0d-45efebf93ff3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.106770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 260/532] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:02.109654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.143202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:02.150342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:02.150999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:02.151281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:02.151558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:02.152383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=91b91c561e944aa5924e3e08bbdf63fe) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:02.152687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:02.154179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:02.165346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 273/533] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:01 2022] GET /identity/v3/role_assignments?user.id=91b91c561e944aa5924e3e08bbdf63fe&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:02.166735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.207845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:02.250522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7a9b-bb07-4b75-908f-df7b7f22b4a2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.301557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e1422-5a93-4da0-bafe-e9e46f94389f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.329154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:02.329952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:02.330235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:02.330505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:02.345046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:02.346185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:02.346635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:02.347059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:02.350207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:02.351765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:02.360892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:02.363119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:02.377747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:02.378822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:02.379859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:02.384918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:02.385875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:02.386778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:02.386778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:02.386778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:02.386778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:02.386992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 261/534] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:02.386992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.388479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 274/535] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:02.393962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.501126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:02.510372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b199e7-a32b-4ef5-a223-b61ab4fbc936 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.546913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:02.547834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:02.548395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:02.548875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:02.549852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:02.550292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:02.551987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:02.565327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 275/536] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:02.571140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.605329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:02.647926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e4a-4c14-4362-867f-01cb45867d95 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.694432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95495c5-ce66-46dd-b03f-bb710b059666 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.695942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:02.700736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:02.700736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:02.700736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:02.700736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:02.700736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:02.700736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:02.715846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 262/537] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:02.725627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.769990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:02.771724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:02.772291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:02.773820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:02.789964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:02.791459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:02.803935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:02.822917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:02.823994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:02.825038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:02.825455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 276/538] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:02.832327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:02.910979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bd549-4d94-4eac-a588-0040968aeb1e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.977477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df661fd-aaad-4af5-a3d6-d9e909e5acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:02.978159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df661fd-aaad-4af5-a3d6-d9e909e5acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:02.978452 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df661fd-aaad-4af5-a3d6-d9e909e5acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:02.978720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df661fd-aaad-4af5-a3d6-d9e909e5acf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:02.979565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df661fd-aaad-4af5-a3d6-d9e909e5acf9 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=ab171a27a8d043869eddc76d2befe09c) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:02.979873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df661fd-aaad-4af5-a3d6-d9e909e5acf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:02.981341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df661fd-aaad-4af5-a3d6-d9e909e5acf9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:02.994559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843cf73-8efb-40f2-95f1-055f8431a7c6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:02.996367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 263/539] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:02 2022] GET /identity/v3/role_assignments?user.id=ab171a27a8d043869eddc76d2befe09c&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:03.042449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d147-51f8-4f98-95ac-8b4f13487deb None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:03.042952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d147-51f8-4f98-95ac-8b4f13487deb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:03.043348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6d147-51f8-4f98-95ac-8b4f13487deb None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:03.044906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 264/540] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:03.052794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c6fb-6177-4dbb-8303-699ea56ff894 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:03.053297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c6fb-6177-4dbb-8303-699ea56ff894 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:03.053699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7c6fb-6177-4dbb-8303-699ea56ff894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:03.067028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:03.084488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cab7c6fb-6177-4dbb-8303-699ea56ff894 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:03.085798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cab7c6fb-6177-4dbb-8303-699ea56ff894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:03.146014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:03.147071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:03.147493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:03.147767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:03.148571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:03.148902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:03.150645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:03.166842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 265/541] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:19:03.176539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 277/542] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:03.185991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c6fb-6177-4dbb-8303-699ea56ff894 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:03.196791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:03.288452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:03.337792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7c6fb-6177-4dbb-8303-699ea56ff894 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:03.371231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73022ad4-5956-4222-8371-41afdd1f32b2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:03.410704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:03.411386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:03.412172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:03.412619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:03.413515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=795571c4c2cc4f969ce487c0ec6dfbd8) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:03.413829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:03.415320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:03.420859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:03.430889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 266/543] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:03 2022] GET /identity/v3/role_assignments?user.id=795571c4c2cc4f969ce487c0ec6dfbd8&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:03.448468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:03.449700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:03.450127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:03.450544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:03.469842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:03.478619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:03.479734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:03.480667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:03.490396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 278/544] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:03.496557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:03.643270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d99596-4fb7-4d31-b17b-8aa665378a52 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:03.680771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:03.682177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:03.682613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:03.683037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:03.683936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:03.684412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:03.685973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:03.696137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 267/545] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:03.701988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:03.839178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2bf3f-55e3-47bf-90dc-532d991c7b91 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:03.867565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:03.886843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:03.887654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:03.887929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:03.888197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:03.905785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:03.907251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:03.927397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:03.928752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:03.930117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:03.930117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:03.930117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:03.930117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:03.930117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 279/546] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:03.937851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:04.061817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:04.132296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932ab25-6c28-4bf7-a462-9014f45a61d4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:04.187532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3aba-9d27-4cdb-ac2c-484f40b61c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:04.188941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3aba-9d27-4cdb-ac2c-484f40b61c6f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.189772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3aba-9d27-4cdb-ac2c-484f40b61c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.190235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3aba-9d27-4cdb-ac2c-484f40b61c6f None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.191199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3aba-9d27-4cdb-ac2c-484f40b61c6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:04.191695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3aba-9d27-4cdb-ac2c-484f40b61c6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:04.194324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3aba-9d27-4cdb-ac2c-484f40b61c6f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:04.215914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 268/547] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:04.221516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:04.298626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea106d0-5006-4257-af0a-aa2b4128394f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.299703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea106d0-5006-4257-af0a-aa2b4128394f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.300212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea106d0-5006-4257-af0a-aa2b4128394f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.302251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 269/548] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:04.307434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790049-0aa1-4c5e-a5e3-abbd56faf12a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.307582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790049-0aa1-4c5e-a5e3-abbd56faf12a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.307866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc790049-0aa1-4c5e-a5e3-abbd56faf12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.326088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cc790049-0aa1-4c5e-a5e3-abbd56faf12a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:04.327791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cc790049-0aa1-4c5e-a5e3-abbd56faf12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:04.402261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657ab54-0af8-4691-b969-8c0aa5d24ca8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:04.411946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 270/549] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:04.455688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:04.456486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.456781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.457094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.465277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:04.466729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:04.476224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790049-0aa1-4c5e-a5e3-abbd56faf12a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:04.481315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:04.482685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:04.484349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 280/550] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:04.488037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:04.552696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:04.577376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:04.672741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc790049-0aa1-4c5e-a5e3-abbd56faf12a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:04.678265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b139f-d50c-4a55-b063-94c3f3368fd1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:04.716151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4f22d-52bb-4760-b49d-c47a1726225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:04.717834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4f22d-52bb-4760-b49d-c47a1726225a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.718320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4f22d-52bb-4760-b49d-c47a1726225a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.718695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4f22d-52bb-4760-b49d-c47a1726225a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.723344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fa6cb-d98e-4c12-8977-10733b30fda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:04.724344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa6cb-d98e-4c12-8977-10733b30fda4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.724825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa6cb-d98e-4c12-8977-10733b30fda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.725547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa6cb-d98e-4c12-8977-10733b30fda4 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.726767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fa6cb-d98e-4c12-8977-10733b30fda4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:04.727233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fa6cb-d98e-4c12-8977-10733b30fda4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:04.729699 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fa6cb-d98e-4c12-8977-10733b30fda4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:04.732354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4f22d-52bb-4760-b49d-c47a1726225a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5ce4f22d-52bb-4760-b49d-c47a1726225a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:04.741056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:04.742113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:04.743085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:04.743704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 271/551] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:04.745204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ff591-9b3f-4147-bd18-52bf79c8e827 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.745642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ff591-9b3f-4147-bd18-52bf79c8e827 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.745979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ff591-9b3f-4147-bd18-52bf79c8e827 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.751409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 272/552] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:04.752907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ff591-9b3f-4147-bd18-52bf79c8e827 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:04.788972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 281/553] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jun 23 11:19:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:04.791007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f280c-148d-4db9-bb7c-fe60e49b5564 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.791293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f280c-148d-4db9-bb7c-fe60e49b5564 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.791564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f280c-148d-4db9-bb7c-fe60e49b5564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.812513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bc6f280c-148d-4db9-bb7c-fe60e49b5564 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:04.813770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc6f280c-148d-4db9-bb7c-fe60e49b5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:04.871441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ff591-9b3f-4147-bd18-52bf79c8e827 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:04.883302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:04.888828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 282/554] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:04.888828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f280c-148d-4db9-bb7c-fe60e49b5564 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:04.908191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:04.932836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:04.933942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:04.934429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:04.934957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:04.935948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:04.936451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:04.938120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:04.950670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 273/555] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:04.952037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:04.995096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f280c-148d-4db9-bb7c-fe60e49b5564 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.030770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.031427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.031705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.031979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.069490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488cb9b-dad4-40dd-af79-d79953821c8e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.104912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.105122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.106525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.106741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.107249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.107740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.119321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:05.127495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:05.128429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:05.129273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:05.129876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.137164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 274/556] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:05.138329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.172673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.219390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 283/557] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:05.219390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.256411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be408a27-7368-4975-bb2d-1f49a23a1b17 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.293296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.294505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.295054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.295522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.307463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.309360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.326069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dbec3-9c86-4656-ad7b-be03de1d66f9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:05.328647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:05.330000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:05.330845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:05.330845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:05.330845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:05.330845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:05.333150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 275/558] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:05.334443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.348144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.364982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.366187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.366379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.366625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.367395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:05.367696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.369067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.382204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 284/559] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:05.382204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.431795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.450747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4ec2-4bbf-4709-9411-c9531b7ccb10 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.487064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.488324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.488431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d74787-2e39-4ede-bae6-72efab1734c4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.488971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.489440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.501823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.503688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:05.522600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:05.523585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:05.524468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:05.524468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:05.524468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:05.524468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:05.531042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 276/560] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:05.531042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.533815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.534497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.534779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.535053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.535795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:05.536101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.537646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.550552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 285/561] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:05.551358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.600904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.639577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f75f-660e-4691-b6cb-5678c5ab46c0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.661638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320d8ea-b5d3-4c92-9018-d1a7b0534a8b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.674114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f4665-913e-4ab5-aa58-280fc5eacc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.674949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4665-913e-4ab5-aa58-280fc5eacc2d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.675231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4665-913e-4ab5-aa58-280fc5eacc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.675506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f4665-913e-4ab5-aa58-280fc5eacc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.678379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.687606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f4665-913e-4ab5-aa58-280fc5eacc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.689137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f4665-913e-4ab5-aa58-280fc5eacc2d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.698795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896d95f-9a7f-4222-a4d9-69ffd1060c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.699466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d95f-9a7f-4222-a4d9-69ffd1060c01 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.699736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d95f-9a7f-4222-a4d9-69ffd1060c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.700008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896d95f-9a7f-4222-a4d9-69ffd1060c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.700745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896d95f-9a7f-4222-a4d9-69ffd1060c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:05.701063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896d95f-9a7f-4222-a4d9-69ffd1060c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.702446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896d95f-9a7f-4222-a4d9-69ffd1060c01 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a88f4665-913e-4ab5-aa58-280fc5eacc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:05.707972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:05.709076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:05.709950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:05.709950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:05.709950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:05.709950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:05.709950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 277/562] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:05.710660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272c66c-d809-4f5a-b0ff-55c97cc9c340 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.710952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272c66c-d809-4f5a-b0ff-55c97cc9c340 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.711232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272c66c-d809-4f5a-b0ff-55c97cc9c340 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.712759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 278/563] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:05.713193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272c66c-d809-4f5a-b0ff-55c97cc9c340 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.719453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 286/564] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:05.720786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f08b-6dad-420d-ad25-e5f10c537ab5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.721073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f08b-6dad-420d-ad25-e5f10c537ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.721348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f08b-6dad-420d-ad25-e5f10c537ab5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.726056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 287/565] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:05.726056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f08b-6dad-420d-ad25-e5f10c537ab5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.822614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272c66c-d809-4f5a-b0ff-55c97cc9c340 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.828854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f08b-6dad-420d-ad25-e5f10c537ab5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:05.830350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.855581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.856397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.856683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.857045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.864009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628fc77-d0de-4f50-bc13-e010d8f82c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:05.864392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.864809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628fc77-d0de-4f50-bc13-e010d8f82c18 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.865112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628fc77-d0de-4f50-bc13-e010d8f82c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.865417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628fc77-d0de-4f50-bc13-e010d8f82c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.865993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.866207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628fc77-d0de-4f50-bc13-e010d8f82c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:05.866542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628fc77-d0de-4f50-bc13-e010d8f82c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:05.868027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628fc77-d0de-4f50-bc13-e010d8f82c18 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:05.879568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 288/566] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:05.879694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:05.881285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 279/567] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:05.882242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:05.884914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e335-b03e-41c6-af59-18914bc03704 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.885302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e335-b03e-41c6-af59-18914bc03704 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.885689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e335-b03e-41c6-af59-18914bc03704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.901947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3053e335-b03e-41c6-af59-18914bc03704 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:05.903145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3053e335-b03e-41c6-af59-18914bc03704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:05.930500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:05.981605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 289/568] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:05.991827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ece80-eb3f-4d8b-aeae-602b1cb4de4d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:05.991827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ece80-eb3f-4d8b-aeae-602b1cb4de4d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:05.991827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ece80-eb3f-4d8b-aeae-602b1cb4de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:05.992129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec63ba-10f6-49dc-8a9f-e419228be864 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.004410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-501ece80-eb3f-4d8b-aeae-602b1cb4de4d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:06.006068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-501ece80-eb3f-4d8b-aeae-602b1cb4de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:06.020435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.021580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.021700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.021914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.028631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.030173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:06.044815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:06.045849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:06.046914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:06.049031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 280/569] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:06.049970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.078725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 290/570] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:06.079525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ece80-eb3f-4d8b-aeae-602b1cb4de4d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.104051 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.159492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a6fa9-6b3e-4bef-bfcd-e6b873653519 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.168967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.182801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ece80-eb3f-4d8b-aeae-602b1cb4de4d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.194627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.195457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.195739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.196024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.203799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.205457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.216478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.217168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.217452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.217730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.218583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:06.218894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.220325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:06.221463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:06.222561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 281/571] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:06.223714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.245472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 291/572] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:06.245472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.322161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.328464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf396fc6-45f7-4b3e-b211-31141c9072c8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.341508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340be7f1-f8c9-4fe0-8a03-d7b32d7c18f7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.363934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.365020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.365381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.365663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.374014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.374674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.374965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.375240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.376028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:06.376343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.376432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:06.377828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:06.384382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:06.385322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:06.386142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 282/573] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:06.386822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.393990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 292/574] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:06.394883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.416510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.487375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463f25-8a82-4d88-a9be-361ffaa90524 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.497390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c4b0-166b-4e53-8d00-b06a8cec071b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.521254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e739af-183a-465f-be92-e18006804595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.522153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e739af-183a-465f-be92-e18006804595 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.522496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e739af-183a-465f-be92-e18006804595 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.523106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e739af-183a-465f-be92-e18006804595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.531035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.531763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.532040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.532312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.533221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:06.533381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e739af-183a-465f-be92-e18006804595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:06.533549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.534971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-34e739af-183a-465f-be92-e18006804595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:06.541068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:06.542119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:06.542952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 283/575] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:06.544246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e739af-183a-465f-be92-e18006804595 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.551659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.557967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 293/576] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:06.558802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.632147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.643945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e739af-183a-465f-be92-e18006804595 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.656842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804657e-571a-4330-971e-cb67f0e5f8b5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.677875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.678684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.678965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.679242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.690176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.690743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.691422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.691637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.691730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.691974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.692916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:06.693229 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.694584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.702752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 294/577] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:06.703533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:06.708508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:06.709423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:06.710284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:06.710284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:06.710284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:06.710284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:06.710284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 284/578] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:06.710560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.764301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.805141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4a9f7-ccc6-4866-a4f9-c17413c54dba None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.813481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450581-7d8b-4427-bd07-9126b19a9973 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.837774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.838428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.838697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.838975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.839801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=954ff9ef0bd54012af73a0b901a7893b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:06.840110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.841683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.846476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:06.847164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:06.847354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 295/579] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/role_assignments?user.id=954ff9ef0bd54012af73a0b901a7893b&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:06.847525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:06.847807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:06.848139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.848623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:06.849075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:06.850475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:06.866795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 285/580] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:06.868206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:06.871208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:06.965936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5b0ef-88da-4cd8-86fc-ce05bc88a5ba None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.982942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0787646-956c-4696-b1f8-025f7b19a6fe None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:06.995563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.015088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.015966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.016245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.016517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.029193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.030750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.030975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.031778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.032058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.032330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.045863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.047344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:07.051180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:07.052397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:07.053351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:07.053351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:07.053351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:07.053351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:07.056868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 296/581] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:07.057996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:07.070942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:07.071831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:07.072695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:07.072695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:07.072695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:07.072695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:07.076844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 286/582] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:07.077909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.134572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.170712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be557f-d7f8-48c3-b2d1-8460e65d369f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.186810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749ceef-b030-4984-bb84-80d75c5479eb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.208095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.209111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.209485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.209760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.210482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:07.210789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.212161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.222458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.223197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.223480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.223752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.229320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 297/583] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:07.229320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.240078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.241561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:07.260254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:07.261193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:07.262077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:07.262077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:07.262077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:07.262077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:07.262077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 287/584] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:07.262930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.266973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.339642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237ba4-d0b7-43dd-b6cb-0383599fe50a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.375544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.376624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.376958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.377233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.378134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:07.378442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.379833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.388653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9b0da-0af3-41d4-b820-d23744bd4aa8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.396637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 298/585] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:07.396637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.398103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.424781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.425548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.425830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.426108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.426813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:07.427150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.428757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.445056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 288/586] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:07.446480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.495541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.502294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868361e1-2af2-4beb-85ff-34e5e21abfd2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.539393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.540157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.540437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.540704 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.548074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.549551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.553946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310080ed-95ef-44fa-8b9b-149dd006af35 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:07.564616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:07.565615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:07.566638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:07.568763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 299/587] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:07.569678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.596616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.597333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.597617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.597894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.598620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:07.598980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.600349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.617113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 289/588] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:07.617113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.644019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.681342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e30364-4662-42f0-a1af-0e1636d876a0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.716425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.717253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.717537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.717818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.721190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd3dad-3b0f-4289-af21-3202ef65058a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.724689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.726248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:07.740805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:07.741681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:07.742557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 300/589] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:07.744087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.759537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.760420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.760699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.761004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.766456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.769350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.771045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:07.785728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:07.786690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:07.787621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 290/590] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:07.788664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.857846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509ca98-558c-41e7-9fd8-f809a16dee8e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.879055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:07.894711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.895452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.895906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.896095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.896192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770b089-27da-419a-9f0f-7190b2043d7b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:07.896897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:07.897211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.899677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.919997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 301/591] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:07.919997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:07.931403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:07.932681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:07.932995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:07.933631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:07.943253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:07.945101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:07.961218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:07.962435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:07.963380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 291/592] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:07.963957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.012553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:08.035647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf18cd7-5a72-4216-a956-587a5fc6567e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.072393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8cedc-64bf-430b-aec3-24c88d74496f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.077367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.078042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.078324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.078597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.079386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:08.080108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.081938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.094769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 302/593] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:08.095460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.111054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.111742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.112022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.112296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.113185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:08.113494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.115170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.132809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 292/594] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jun 23 11:19:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:08.133614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.141510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:08.201170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7355a-c297-4a8b-93f9-c079ef9a3085 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.234902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.235795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.236081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.236358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/bb2aadd5a1204d35a8325b3d56d20b03/roles/05a89bc0931e46538d695e23d585c162` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.238136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b162502-d196-4bfe-ae70-6af78a509b8e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.239556 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:08.252442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=bb2aadd5a1204d35a8325b3d56d20b03, role_id=05a89bc0931e46538d695e23d585c162)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.253992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.267425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 303/595] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:08 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/bb2aadd5a1204d35a8325b3d56d20b03/roles/05a89bc0931e46538d695e23d585c162 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:08.273974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.276253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.277014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.277350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.277630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.278594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:08.279046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.281109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.301830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 293/596] 10.222.0.66 () {56 vars in 1139 bytes} [Thu Jun 23 11:19:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:08.302793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.372705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:08.426132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069da7ae-ee4c-4338-ae1f-aed4688fc22d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.427894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c509b-5c7d-4825-88f4-1b079e8fdf0c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.469115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.470403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.470862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.471131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/91b91c561e944aa5924e3e08bbdf63fe/roles/05a89bc0931e46538d695e23d585c162` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.472075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.473155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.473499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.474065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.486992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.488171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=91b91c561e944aa5924e3e08bbdf63fe, role_id=05a89bc0931e46538d695e23d585c162)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.488466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.492777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.507435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 304/597] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:08 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/91b91c561e944aa5924e3e08bbdf63fe/roles/05a89bc0931e46538d695e23d585c162 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:08.508332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:08.518345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:08.519428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:08.520483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:08.520483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:08.520483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:08.520483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:08.522518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 294/598] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:08.528108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.558519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:08.646673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc0757e-05f8-4847-ae11-bed3ac93afa3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.686700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbded35-dde1-47db-91dd-7c41b141f174 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.704376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:08.715409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.716696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.717192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.717605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.729369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.729815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adddee-0218-48db-a593-1d892288f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.730574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adddee-0218-48db-a593-1d892288f41a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.730919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adddee-0218-48db-a593-1d892288f41a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.731260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adddee-0218-48db-a593-1d892288f41a None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.731789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.732125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adddee-0218-48db-a593-1d892288f41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:08.732499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adddee-0218-48db-a593-1d892288f41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.734110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adddee-0218-48db-a593-1d892288f41a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.755407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 295/599] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:08.755407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adddee-0218-48db-a593-1d892288f41a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:08.759740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:08.760997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:08.762036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:08.762036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:08.762036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:08.762036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:08.764056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 305/600] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:08.780937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.886446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adddee-0218-48db-a593-1d892288f41a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.899422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828768d6-4764-4a74-b7ac-b11159c50dbf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:08.909078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:08.927624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbc5e4-08d0-4487-b244-54f3883d4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.928590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc5e4-08d0-4487-b244-54f3883d4bed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.928986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc5e4-08d0-4487-b244-54f3883d4bed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.929320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbc5e4-08d0-4487-b244-54f3883d4bed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.936817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc5e4-08d0-4487-b244-54f3883d4bed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.938270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266b70a-0667-4504-8f39-9b24eff95837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:08.938393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbc5e4-08d0-4487-b244-54f3883d4bed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.938963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b70a-0667-4504-8f39-9b24eff95837 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.939621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b70a-0667-4504-8f39-9b24eff95837 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.939895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b70a-0667-4504-8f39-9b24eff95837 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.940635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266b70a-0667-4504-8f39-9b24eff95837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:08.940992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266b70a-0667-4504-8f39-9b24eff95837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:08.942484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266b70a-0667-4504-8f39-9b24eff95837 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-7acbc5e4-08d0-4487-b244-54f3883d4bed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:08.954497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:08.955385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:08.956259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 296/601] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:08.957737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e00f-204d-490a-abe1-792ac867648e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.957737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e00f-204d-490a-abe1-792ac867648e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.957737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541e00f-204d-490a-abe1-792ac867648e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.959379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 297/602] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:08.965645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541e00f-204d-490a-abe1-792ac867648e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:08.970815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 306/603] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:08.973309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d3aa-2b01-4ce0-ac74-1aef8833a600 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:08.973593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d3aa-2b01-4ce0-ac74-1aef8833a600 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:08.973992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05d3aa-2b01-4ce0-ac74-1aef8833a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:08.994579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-de05d3aa-2b01-4ce0-ac74-1aef8833a600 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:08.996132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-de05d3aa-2b01-4ce0-ac74-1aef8833a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:09.010910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:09.096025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 307/604] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:09.096025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05d3aa-2b01-4ce0-ac74-1aef8833a600 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:09.099256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541e00f-204d-490a-abe1-792ac867648e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.145456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.146620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.147149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.147622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.148698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:09.149680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:09.151790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:09.168124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 298/605] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:09.169322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:09.197661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:09.220316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05d3aa-2b01-4ce0-ac74-1aef8833a600 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.263265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.264541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.264872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.265149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.274929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:09.276416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:09.283208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:09.291030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca738aac-8b80-4d27-badc-b8a7788e4a7d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:09.295577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:09.296435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:09.297391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:09.300863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 308/606] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:09.302002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:09.344129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.345038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.345351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.345628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.359401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:09.368692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:09.369631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:09.370470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:09.378003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 299/607] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:09.379127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:09.416698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b660d-7c7a-4bff-8d09-f16990acab7e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.453023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.454395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.454897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.455365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/ab171a27a8d043869eddc76d2befe09c/roles/05a89bc0931e46538d695e23d585c162` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.465038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:09.472031 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=ab171a27a8d043869eddc76d2befe09c, role_id=05a89bc0931e46538d695e23d585c162)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:09.474050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:09.501281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 309/608] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:09 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/ab171a27a8d043869eddc76d2befe09c/roles/05a89bc0931e46538d695e23d585c162 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:09.502152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:09.514275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0278-76b7-4d3f-8ccd-ee3946e862a4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.586735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.587499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.587789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.588069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.588899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:09.589360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:09.590962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:09.619239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 300/609] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:09.624520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9332aea-cc1d-4213-ab89-a780c5c876ec None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.625843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:09.665608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.666304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.666634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.667059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.667842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:09.668152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:09.669634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:09.673076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:09.680560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 310/610] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:09.690175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:09.765058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:09.835816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feab07-3e9e-493e-9e4c-6b26b18dcb63 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.848081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c51e6d-6e4d-4d95-aed3-d2eb41455f2d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:09.886025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.886749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.887030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.887305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.902086 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:09.903015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:09.903293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:09.903570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/795571c4c2cc4f969ce487c0ec6dfbd8/roles/05a89bc0931e46538d695e23d585c162` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:09.916703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:09.918206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:09.931967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=795571c4c2cc4f969ce487c0ec6dfbd8, role_id=05a89bc0931e46538d695e23d585c162)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:09.933469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:09.948423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:09.949350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:09.950219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:09.950219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:09.950219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:09.950219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:09.950219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 311/611] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:09.960502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 301/612] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:09 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/795571c4c2cc4f969ce487c0ec6dfbd8/roles/05a89bc0931e46538d695e23d585c162 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:09.961614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:10.124408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557b63f-cc43-4ed8-bbdd-7b388aee5e20 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:10.126262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:10.171422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:10.172021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:10.172305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:10.172572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:10.173357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:10.173653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:10.175035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:10.190034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 312/613] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:10.195707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:10.287608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:10.346378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d461cf-e986-441d-8c49-7fdf367cc9c2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:10.391319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:10.392439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:10.392916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:10.393364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:10.406523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:10.408250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:10.426031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:10.427027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:10.427957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:10.436750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:10.438041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 302/614] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:10.555899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a49fbf-87cb-4774-950c-e51fa9c613a0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:10.590584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657f23e-150d-4ca3-8f1c-b9c05ce3141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:10.591269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f23e-150d-4ca3-8f1c-b9c05ce3141b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:10.591558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f23e-150d-4ca3-8f1c-b9c05ce3141b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:10.591832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f23e-150d-4ca3-8f1c-b9c05ce3141b None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:10.592673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657f23e-150d-4ca3-8f1c-b9c05ce3141b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:10.593013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657f23e-150d-4ca3-8f1c-b9c05ce3141b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:10.594452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657f23e-150d-4ca3-8f1c-b9c05ce3141b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:10.612372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 313/615] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jun 23 11:19:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:10.617993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:10.678172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf089-443e-4915-af14-f48fc648f917 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:10.678804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf089-443e-4915-af14-f48fc648f917 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:10.679352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf089-443e-4915-af14-f48fc648f917 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:10.681206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 314/616] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:10.687781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e911-25f4-4939-8f2c-367e5b153bf4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:10.688362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e911-25f4-4939-8f2c-367e5b153bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:10.689433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e911-25f4-4939-8f2c-367e5b153bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:10.706406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b490e911-25f4-4939-8f2c-367e5b153bf4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:10.707927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b490e911-25f4-4939-8f2c-367e5b153bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:10.729132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:10.730259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fd65e-c94a-499b-8b53-68ce30f1fe66 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:10.774321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:10.799698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:10.800515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:10.800822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:10.801096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:10.813038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:10.814866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:10.834040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:10.834943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:10.835814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:10.835814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:10.835814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:10.835814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:10.835814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 303/617] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:10.838825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 315/618] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:19:10.856327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:10.875991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490e911-25f4-4939-8f2c-367e5b153bf4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.016278 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e983e-2406-4588-bfec-c99a81c2ec5b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.052697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490e911-25f4-4939-8f2c-367e5b153bf4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.056395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff3c30-aa66-4349-9e5b-051d0e2c2e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.057675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff3c30-aa66-4349-9e5b-051d0e2c2e68 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.057675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff3c30-aa66-4349-9e5b-051d0e2c2e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.057675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff3c30-aa66-4349-9e5b-051d0e2c2e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.058538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff3c30-aa66-4349-9e5b-051d0e2c2e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:11.058753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff3c30-aa66-4349-9e5b-051d0e2c2e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:11.060049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff3c30-aa66-4349-9e5b-051d0e2c2e68 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:11.076123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 304/619] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:11.078138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c6c5-810b-4afd-b4f4-a9cefbe428f4 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.078433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c6c5-810b-4afd-b4f4-a9cefbe428f4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.078717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0c6c5-810b-4afd-b4f4-a9cefbe428f4 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.080253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 305/620] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:11.085786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0c6c5-810b-4afd-b4f4-a9cefbe428f4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.100948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5937f1-7b30-480e-aff1-4b4660e72515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.102091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5937f1-7b30-480e-aff1-4b4660e72515 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.102573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5937f1-7b30-480e-aff1-4b4660e72515 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.102988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5937f1-7b30-480e-aff1-4b4660e72515 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.114508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5937f1-7b30-480e-aff1-4b4660e72515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6b5937f1-7b30-480e-aff1-4b4660e72515 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:11.122703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:11.123672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:11.124528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:11.132774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:11.133053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 316/621] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:11.134583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61600c72-a393-41ac-a2ed-04c9631455ee None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.135054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61600c72-a393-41ac-a2ed-04c9631455ee None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.135521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61600c72-a393-41ac-a2ed-04c9631455ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.153341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-61600c72-a393-41ac-a2ed-04c9631455ee None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:11.154876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-61600c72-a393-41ac-a2ed-04c9631455ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:11.158864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:11.222890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0c6c5-810b-4afd-b4f4-a9cefbe428f4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.232804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 317/622] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:11.233946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61600c72-a393-41ac-a2ed-04c9631455ee None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.263236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.263236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.263236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.263236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.271176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:11.272894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:11.288862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:11.289885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 306/623] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:11.291260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.377486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61600c72-a393-41ac-a2ed-04c9631455ee None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.396387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:11.407306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6a9a-b3ae-435b-a0c2-e480798c3f27 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.420698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.421424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.421705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.421976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.422738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:11.423040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:11.424462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:11.433738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 318/624] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:11.434878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.437540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:11.455340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.456700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.457404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.457833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.472286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:11.482454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:11.483556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:11.484555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:11.487548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 307/625] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:11.488821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.546737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbae7c-9ff1-44a2-8084-6863cc7ffc77 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.581899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.582739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.583174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.583557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.584420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:11.584851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:11.586372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:11.604750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 319/626] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:11.604750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.621786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d30f3-0f23-44e1-b553-cb7e5f4ba72a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.657704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.658691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.659067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.659440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.673249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:11.675323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:11.684435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:11.698507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:11.699523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:11.700379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:11.700379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:11.700379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:11.700379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:11.700609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 308/627] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:11.701893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.716418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:11.739158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1993-13b6-4e40-9f8f-487d1787063b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.791757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.792443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.792740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.793017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.793767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:11.794093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:11.795465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:11.811834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 320/628] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:11.813424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.837347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01d348-d99a-4982-9ac6-bdfd63bca17d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.884704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:11.886010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:11.886676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:11.887098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/954ff9ef0bd54012af73a0b901a7893b/roles/05a89bc0931e46538d695e23d585c162` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:11.907246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=954ff9ef0bd54012af73a0b901a7893b, role_id=05a89bc0931e46538d695e23d585c162)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:11.909539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:11.920260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c42f24-f604-4395-8d68-f995e5ee7aa2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:11.936828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 309/629] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:11 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/954ff9ef0bd54012af73a0b901a7893b/roles/05a89bc0931e46538d695e23d585c162 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:11.936828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:11.978735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.005193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565b42-47d5-4a35-b037-f346481cd843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.006378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565b42-47d5-4a35-b037-f346481cd843 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.007448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565b42-47d5-4a35-b037-f346481cd843 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.008580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565b42-47d5-4a35-b037-f346481cd843 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.011395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d565b42-47d5-4a35-b037-f346481cd843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:12.011998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d565b42-47d5-4a35-b037-f346481cd843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.014322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d565b42-47d5-4a35-b037-f346481cd843 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.031688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 321/630] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:12.033143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc91e3-da43-4955-9584-fd330ff5b2f1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.033429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc91e3-da43-4955-9584-fd330ff5b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.033703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc91e3-da43-4955-9584-fd330ff5b2f1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.035313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 322/631] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:12.036956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc91e3-da43-4955-9584-fd330ff5b2f1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.060745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.127480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a440e-a4c5-425e-96c7-25a4bb48c5a9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.166048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f44f8-2fc7-48ff-ba51-9736a778cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.166954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f44f8-2fc7-48ff-ba51-9736a778cec2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.167253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f44f8-2fc7-48ff-ba51-9736a778cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.167616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f44f8-2fc7-48ff-ba51-9736a778cec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.171940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc91e3-da43-4955-9584-fd330ff5b2f1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.179093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f44f8-2fc7-48ff-ba51-9736a778cec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.180657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f44f8-2fc7-48ff-ba51-9736a778cec2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-223f44f8-2fc7-48ff-ba51-9736a778cec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:12.201531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:12.202464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:12.203353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:12.203353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:12.203353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:12.203353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:12.203353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 310/632] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:12.204612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531327a8-a084-403f-8814-e51b3e849e30 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.206657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531327a8-a084-403f-8814-e51b3e849e30 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.206657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531327a8-a084-403f-8814-e51b3e849e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.210430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.211560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.212835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.213115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.222042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.223332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-531327a8-a084-403f-8814-e51b3e849e30 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:12.223582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.224758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-531327a8-a084-403f-8814-e51b3e849e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:12.241803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:12.243968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 323/633] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:12.246168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.303473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.312865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 311/634] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:12.315204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531327a8-a084-403f-8814-e51b3e849e30 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.372264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.385051 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c33ea7-ec1f-4563-9e87-86697fa122cd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.428144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.428861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.429148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.429305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531327a8-a084-403f-8814-e51b3e849e30 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.429412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.430136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:12.430443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.432192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.450394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 324/635] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:12.451015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.464482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02363d2c-df5a-4b39-9ba7-1d7be86a131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.465213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363d2c-df5a-4b39-9ba7-1d7be86a131c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.465497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363d2c-df5a-4b39-9ba7-1d7be86a131c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.465771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363d2c-df5a-4b39-9ba7-1d7be86a131c None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.466620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02363d2c-df5a-4b39-9ba7-1d7be86a131c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:12.466932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02363d2c-df5a-4b39-9ba7-1d7be86a131c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.468351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02363d2c-df5a-4b39-9ba7-1d7be86a131c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.491364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 312/636] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:12.491364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04562839-6051-4950-874d-d0cb18ed4713 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.491364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04562839-6051-4950-874d-d0cb18ed4713 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.491364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04562839-6051-4950-874d-d0cb18ed4713 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.491364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 313/637] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:12.491809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04562839-6051-4950-874d-d0cb18ed4713 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.562519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea6727-4975-4c01-b5ef-7c76366772f2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.565662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.598242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.602228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.603312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.603643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.603858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.604217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04562839-6051-4950-874d-d0cb18ed4713 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.615458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:12.623060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:12.624052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:12.624904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 325/638] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:12.625621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.644853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b82e-ef93-4ed9-845e-ac30b1b29035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.645809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b82e-ef93-4ed9-845e-ac30b1b29035 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.646156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b82e-ef93-4ed9-845e-ac30b1b29035 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.646651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b82e-ef93-4ed9-845e-ac30b1b29035 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.658836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81b82e-ef93-4ed9-845e-ac30b1b29035 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.660293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81b82e-ef93-4ed9-845e-ac30b1b29035 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5d81b82e-ef93-4ed9-845e-ac30b1b29035 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:12.679884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:12.681009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:12.681951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 314/639] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:12.683174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3cfcb-29fa-4bb5-86c9-b9da56854f1a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.683493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3cfcb-29fa-4bb5-86c9-b9da56854f1a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.683771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3cfcb-29fa-4bb5-86c9-b9da56854f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.703567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1fa3cfcb-29fa-4bb5-86c9-b9da56854f1a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:12.704790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1fa3cfcb-29fa-4bb5-86c9-b9da56854f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:12.745887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445f5a3-4b23-4579-8687-992e40bbbf47 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.776885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 315/640] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:12.776885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3cfcb-29fa-4bb5-86c9-b9da56854f1a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.789930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.790665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.791110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.791456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.825422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.862811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.865089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.866576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.876782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3cfcb-29fa-4bb5-86c9-b9da56854f1a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.915527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.916165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.916472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.916802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.917682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:12.918105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.919479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.932451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 316/641] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:12.932451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.980522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 326/642] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:12.980522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.039036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa19fd-9b59-4f0d-982a-d03508058c23 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.057118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.076297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.077061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.077685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.077970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.078841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:13.079154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.080635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.100198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 317/643] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:13.101074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.108424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1c56-d8e8-4f48-b307-b2a51fd86b74 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.113821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.145412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.146269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.146544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.146824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.158108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:13.165889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:13.167073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 327/644] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:13.167931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.217539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682aff4-08d2-47d2-9a13-94753423e889 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.253748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.254550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.254849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.255128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.264996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.266550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.277369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daabec-c5fe-40f8-b7d3-ad2fea05b859 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:13.284685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:13.285739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:13.287261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:13.287261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:13.287261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.287261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:13.287261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 318/645] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:13.287261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.306569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.318302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.319102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.319383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.319661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.330235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.331665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.348490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:13.348627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:13.349489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:13.350347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:13.350347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:13.350347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.350347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:13.350347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 328/646] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:13.350624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.395154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1cf04-d7d5-447d-be05-ad3c2fa632f7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.430710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.431552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.432013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.432350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.462911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b8e50-3054-42db-abf3-db779d4645be None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.499376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.500127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.500430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.500709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.501486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:13.501795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.503193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.505125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.506976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.515898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 329/647] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:13.515898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.559327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.571900 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.616049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 319/648] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:13.616943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.627291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea52243-07ae-4754-b7de-50cc5627b1a0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.662297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.662964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.663246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.663522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.664243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:13.664547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.665948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.678118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 330/649] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:13.679022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.729817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8c4fd-e38d-46f6-96e0-cc0e22d05f35 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.764994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.765680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.765957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.766317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.766981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:13.767295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.768685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.780782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 320/650] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:13.781381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.789559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.794167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c788-f973-40d3-b005-07e8446624a4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.807804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:13.832585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.833564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.833851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.834129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.845304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.846899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:13.866422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:13.867339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:13.868221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:13.868221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:13.868221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.868221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:13.868221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 331/651] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:13.869257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.897726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee3cc-733f-4644-acc6-441a8898ca9f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.938341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.939651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.940683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.940993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.953720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.955263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.970054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad2e6-4b6f-4c3b-be0d-d94a83a7573b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:13.973070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:13.974139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:13.975611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:13.975611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:13.975611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:13.975611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:13.975611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 321/652] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:13.975611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.010721 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.012022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.012493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.012997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.023293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.024788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:14.039141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:14.040239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 332/653] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:14.041449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.047076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.060070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.078668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e2c49-40fd-4f13-a6ee-f0d97f1d4c8c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.111656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.112464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.112780 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.113060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.119854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.121349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:14.135467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:14.136542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 322/654] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:14.137643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.152253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96e15d-c8c7-4686-9f9b-761b533cb913 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.185870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbaa5e-744d-4a64-8a9f-5c2717994a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.186528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbaa5e-744d-4a64-8a9f-5c2717994a8f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.186809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbaa5e-744d-4a64-8a9f-5c2717994a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.187122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbaa5e-744d-4a64-8a9f-5c2717994a8f None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.187814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbaa5e-744d-4a64-8a9f-5c2717994a8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:14.188119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbaa5e-744d-4a64-8a9f-5c2717994a8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.189862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbaa5e-744d-4a64-8a9f-5c2717994a8f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.201026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 333/655] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:14.202237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9c51-16ac-46ad-a808-0e57f36a819e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.202525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9c51-16ac-46ad-a808-0e57f36a819e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.202803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b9c51-16ac-46ad-a808-0e57f36a819e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.204019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 334/656] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:14.204698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9c51-16ac-46ad-a808-0e57f36a819e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.236386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53dd98e-bf35-4b7a-a651-7d3eb2fdc3cf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.265321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.270475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.271136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.271417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.271685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.272401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:14.272701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.274101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.274496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.285633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 323/657] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:14.286621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.309828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b9c51-16ac-46ad-a808-0e57f36a819e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.343485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad79611-2779-486b-be29-777111f4101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.344231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad79611-2779-486b-be29-777111f4101e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.344602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad79611-2779-486b-be29-777111f4101e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.344909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad79611-2779-486b-be29-777111f4101e None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.345736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad79611-2779-486b-be29-777111f4101e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:14.346045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad79611-2779-486b-be29-777111f4101e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.347467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad79611-2779-486b-be29-777111f4101e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.364450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 335/658] 10.222.0.66 () {56 vars in 1137 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:14.365281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad79611-2779-486b-be29-777111f4101e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.385027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80364d54-6799-4fc1-9945-75c13d6efd88 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.417190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98438b94-7d9c-4543-838c-ccf841f1cab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.417844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98438b94-7d9c-4543-838c-ccf841f1cab8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.418125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98438b94-7d9c-4543-838c-ccf841f1cab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.418393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98438b94-7d9c-4543-838c-ccf841f1cab8 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.419176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98438b94-7d9c-4543-838c-ccf841f1cab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:14.419477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98438b94-7d9c-4543-838c-ccf841f1cab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.420926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98438b94-7d9c-4543-838c-ccf841f1cab8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.433390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 324/659] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:14.434606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94183bb-5457-4629-ba55-6561aa6fc4aa None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.434890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94183bb-5457-4629-ba55-6561aa6fc4aa None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.435175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94183bb-5457-4629-ba55-6561aa6fc4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.451075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a94183bb-5457-4629-ba55-6561aa6fc4aa None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:14.452276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a94183bb-5457-4629-ba55-6561aa6fc4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:14.464433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad79611-2779-486b-be29-777111f4101e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.489920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.498180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.498328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.499002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.499276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.499577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.506971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.508435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.518934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 325/660] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:14.519702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94183bb-5457-4629-ba55-6561aa6fc4aa None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:14.523399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:14.524441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:14.525530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 336/661] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:14.529528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.626310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e009f-a817-426f-9a64-f126b87429c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.636947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94183bb-5457-4629-ba55-6561aa6fc4aa None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.659543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.660263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.660545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.660851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.669684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.670486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.670768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.671068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.677750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.679202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:14.693641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:14.694697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:14.695830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:14.696616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 326/662] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:14.698268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.721290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.735225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.736683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.745030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.801240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ee756-3ba3-4726-92f9-24b0a4c9f1ea None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.835277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 337/663] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:14.836115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.841456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.842127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.842406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.842678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.843510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=bb2aadd5a1204d35a8325b3d56d20b03) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:14.843826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.845314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.857970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 327/664] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/role_assignments?user.id=bb2aadd5a1204d35a8325b3d56d20b03&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:14.857970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.930389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.947719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd28c12-6d50-492e-a076-a8cca041a672 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.971627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90909d7-f33b-4ecb-bb35-4a9d281d68e6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.980676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:14.991690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.992385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.992672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.992983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.993835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:14.994148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.995613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.013612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.014557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.015588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.015588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.016253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 338/665] 10.222.0.66 () {56 vars in 1139 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:15.017182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.029331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:15.037705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:15.038663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 328/666] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:15.039916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.139385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf842b-2b44-4646-b285-2ff1803a7b48 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.153323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f63597-a844-470f-9df4-b7214860f3c7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.183392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.184090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.184369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.184642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.185471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:15.185788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.187235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.188737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.189894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.190232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.190515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.200221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 339/667] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:15.201361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.206651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.208143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.213841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:15.226615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:15.227529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:15.228398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:15.228398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:15.228398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:15.228398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:15.232337 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 329/668] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:15.233265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.254488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.314469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f11bca-b4e3-4cf1-bec8-dd85e69941ce None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.339441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ae162-61d8-44ed-9cdf-d0f1d9d9f3dd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.347805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.348571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.348918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.349199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.374307 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.375140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.375521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.375856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.376599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:15.376937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.378307 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.390290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 330/669] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:15.390290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.424119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.425614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.434185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.473015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.492940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8809a-aa94-4acb-8e23-64edfcfe1d63 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.525902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.526557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.526832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.527105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.527930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=91b91c561e944aa5924e3e08bbdf63fe) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:15.528234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.529691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.544745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 331/670] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/role_assignments?user.id=91b91c561e944aa5924e3e08bbdf63fe&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:15.544745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.545066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 340/671] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:15.545066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.661505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49812fc0-c5f9-4735-9041-9ed5b191ea63 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.667514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbac35-c465-4313-a209-cad76eb6b763 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.679283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.702655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.703693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.704150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.704660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.705713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:15.706205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.707926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.714445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.715418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.715791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.716156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.723028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 332/672] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:15.724315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.730183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.732108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.733015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:15.761513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:15.762607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:15.763597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:15.763597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:15.763597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:15.763597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:15.763597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 341/673] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:15.763863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.846393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c25c2a-958f-4ed2-ad22-ad5b918a61ee None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.883964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e46f76-378e-4d82-95be-7c864f4a2bae None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.889167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.890049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.890399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.890744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.904020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.906121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.919294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.920105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.920469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.920831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:15.928003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:15.929073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:15.930139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:15.930139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:15.930139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:15.930139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:15.930416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.932496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.932803 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 333/674] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:15.933703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:15.952085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:15.953293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:15.954487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:15.956109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 342/675] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:15.957068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.982581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.012607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.063732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960ead9-6d80-4b04-80c6-2a3c7f88f2f9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.090725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725822ff-2d5b-43b6-bc40-fceda702dfe8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.102397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.103176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.103823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.103932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.104700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:16.105105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.106720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.124405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 334/676] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:16.125681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.134524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.135472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.135923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.136912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.137889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:16.138367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.140733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.157065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 343/677] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:16.158145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.241056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c0301-c207-41c5-bb66-e37cb6c0ce29 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.260309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.265593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.282057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.283102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.283628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.284089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.285242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:16.285823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.287587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.292705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7fb86-1ebe-4903-9b60-b4b2b9d0d75a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.301922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 335/678] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:16.303239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.343008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.344809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.345158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.345550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.355452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.357303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:16.377300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:16.378487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:16.379786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:16.385156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 344/679] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:16.386176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.421681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440d5b-cb59-4554-910a-e71f0afeaf8d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.459612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.460891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.461393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.461859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.471518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.473347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:16.491566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:16.492498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:16.493399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:16.495904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 336/680] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:16.495904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.523559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08266c-e177-4ef2-a568-62d768e843db None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.544605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.566620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.567476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.567843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.568272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.569710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=ab171a27a8d043869eddc76d2befe09c) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:16.570160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.572116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.580615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 345/681] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/role_assignments?user.id=ab171a27a8d043869eddc76d2befe09c&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:16.581658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.585475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.632225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f18577-c00b-4fe4-8a40-252fa54deda0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.710649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.711368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.711647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.711918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.712836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:16.713149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.714628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.750576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 337/682] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:16.757010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.774336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a854495-904f-4196-a29b-4f8cf1d6fce6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.814585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.815680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.816185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.816670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.818682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:16.819237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.821024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.841067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 346/683] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:16.842951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.877863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.886134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131855a-40d3-43eb-9940-3d463128415f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.914547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.929568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.930234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.930513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.930786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.960986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6d87c-9ffa-4f18-a53f-92ff80ce8847 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.001405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9662e-db99-4a13-be86-e910f1778584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.002273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9662e-db99-4a13-be86-e910f1778584 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.002650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9662e-db99-4a13-be86-e910f1778584 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.003039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9662e-db99-4a13-be86-e910f1778584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.004076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9662e-db99-4a13-be86-e910f1778584 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=795571c4c2cc4f969ce487c0ec6dfbd8) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:17.004471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9662e-db99-4a13-be86-e910f1778584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.006361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9662e-db99-4a13-be86-e910f1778584 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.018921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.021237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 347/684] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/role_assignments?user.id=795571c4c2cc4f969ce487c0ec6dfbd8&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:17.021998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.150566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5854560-93f5-40e5-b96d-d9b068e28e0e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.150903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5854560-93f5-40e5-b96d-d9b068e28e0e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.151121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5854560-93f5-40e5-b96d-d9b068e28e0e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.155040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:17.155984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 348/685] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:17.165954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c821-226f-403c-93d4-450df44320b6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.166297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c821-226f-403c-93d4-450df44320b6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.166599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00c821-226f-403c-93d4-450df44320b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.167754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 338/686] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:17.173416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.205093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dd00c821-226f-403c-93d4-450df44320b6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:17.206580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dd00c821-226f-403c-93d4-450df44320b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:17.282142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6491a-d8a5-4352-b7b8-30d52638a506 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.309079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 349/687] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:19:17.325670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.326490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.326772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.327089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.337601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c821-226f-403c-93d4-450df44320b6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.339238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.340855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:17.359928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:17.361053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:17.361918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:17.361918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:17.361918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:17.361918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:17.361918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 339/688] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:17.366639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.415422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:17.423720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:17.474100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00c821-226f-403c-93d4-450df44320b6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.485540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cb99b-9530-4aac-81ce-865fcf235287 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.520634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.521808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.522260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.522763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.525274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.525966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.526247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.526522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.527254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:17.527562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.529026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.538276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:17.543232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 340/689] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:17.547123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:17.548045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:17.549435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:17.551640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 350/690] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:17.558071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.562171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.694275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8bae5-1411-4f16-804b-fd934f0d04c1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.705188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:17.732765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.734282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.734668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.735045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.743412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.745057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.768691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc95af7-80ba-4e0f-bd56-4e0e3cd6ee89 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:17.771236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:17.772160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:17.773071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 341/691] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:17.781290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.804741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:17.826295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.826973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.827378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.827655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.828398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:17.828697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.830260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.840344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 351/692] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:17.845779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.934248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a236-74fa-4efe-83e1-bc873065ceb3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.968301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf497db-f0a8-4fb2-b2bc-7d9851838858 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.976491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f150589-9a8a-4789-86aa-bd24820f6593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.977197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150589-9a8a-4789-86aa-bd24820f6593 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.977473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150589-9a8a-4789-86aa-bd24820f6593 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.977743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150589-9a8a-4789-86aa-bd24820f6593 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.978950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150589-9a8a-4789-86aa-bd24820f6593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:17.979265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150589-9a8a-4789-86aa-bd24820f6593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.980708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150589-9a8a-4789-86aa-bd24820f6593 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.996879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 342/693] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:17.998599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dce84-c1b0-43c2-9781-f09e88e8201a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.999097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dce84-c1b0-43c2-9781-f09e88e8201a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.999602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05dce84-c1b0-43c2-9781-f09e88e8201a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.001106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 343/694] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:18.006322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dce84-c1b0-43c2-9781-f09e88e8201a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.017369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fa8a5-9eaf-4b74-b641-156d571b4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.018558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fa8a5-9eaf-4b74-b641-156d571b4abd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.019058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fa8a5-9eaf-4b74-b641-156d571b4abd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.019542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fa8a5-9eaf-4b74-b641-156d571b4abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.031691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fa8a5-9eaf-4b74-b641-156d571b4abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.033458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fa8a5-9eaf-4b74-b641-156d571b4abd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.037812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d32fa8a5-9eaf-4b74-b641-156d571b4abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:18.054270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:18.055247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:18.056150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:18.056150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:18.056150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:18.056150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:18.058624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 352/695] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:18.060085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdab3d-4ab4-42e9-9e60-65e8022858d2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.060938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdab3d-4ab4-42e9-9e60-65e8022858d2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.061729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdab3d-4ab4-42e9-9e60-65e8022858d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.082989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-14cdab3d-4ab4-42e9-9e60-65e8022858d2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:18.084301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-14cdab3d-4ab4-42e9-9e60-65e8022858d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:18.113186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:18.128000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05dce84-c1b0-43c2-9781-f09e88e8201a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:18.158188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 353/696] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:18.159355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdab3d-4ab4-42e9-9e60-65e8022858d2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.179272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.179993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.180316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.180629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.181491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=954ff9ef0bd54012af73a0b901a7893b) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:18.183204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.184693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.194202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 344/697] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:18 2022] GET /identity/v3/role_assignments?user.id=954ff9ef0bd54012af73a0b901a7893b&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:18.195247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.373997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdab3d-4ab4-42e9-9e60-65e8022858d2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:18.380128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:18.402607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd93d7c-c7d2-4ccb-92da-071c933bd30d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:18.430945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.432315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.432855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.433363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.434301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:18.434924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.436690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.450838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 354/698] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:18.454636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.454636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.454636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.454636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.456367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.472424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.474940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.492337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:18.496544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:18.497576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:18.498462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:18.498462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:18.498462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:18.498462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:18.498969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 345/699] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:18.505409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.589772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d28662-b45c-4126-9eeb-c8a311841182 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:18.620684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd823918-1b18-41a5-b7bf-46cedfe96e1d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:18.629575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.630705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.631207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.631677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.640187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.641992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.656454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.657155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.657433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.657704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:18.658352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:18.659247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:18.660193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:18.660853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:18.660853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.660853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.663350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 355/700] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:19:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:18.668673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.672751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 346/701] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:18.678190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.680994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:18.773146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:18.783576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c830d48-8945-4111-aea1-e1f883440565 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:18.791182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173818a-635c-49e7-87d7-78c5243c2cb4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:18.826530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.827817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.828301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.828658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:18.829048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.829362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:18.829640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:18.829912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:18.830615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.831024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:18.831539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:18.832041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.833693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:18.853903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 347/702] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:19:18 2022] POST /identity/v3/users => generated 254 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:18.856025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 356/703] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:19:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:18.865061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:18.952511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:19.000170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b0ae0-48ad-4542-8127-5999349c651d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:19.061544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d97944-f23e-4b1a-be90-50fbf5a5a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:19.062239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97944-f23e-4b1a-be90-50fbf5a5a145 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.062520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97944-f23e-4b1a-be90-50fbf5a5a145 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.062786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d97944-f23e-4b1a-be90-50fbf5a5a145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.176488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d97944-f23e-4b1a-be90-50fbf5a5a145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:19.177968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d97944-f23e-4b1a-be90-50fbf5a5a145 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:19.254124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:19.298961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 348/704] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:19.304734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:19.348110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a793-bad7-4ac7-8803-5b00a07a22a4 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.348503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a793-bad7-4ac7-8803-5b00a07a22a4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.348745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a793-bad7-4ac7-8803-5b00a07a22a4 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.350416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 349/705] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:19.355824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8312e6-e971-46f4-8958-896d379b27d0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.356224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8312e6-e971-46f4-8958-896d379b27d0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.356572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8312e6-e971-46f4-8958-896d379b27d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.386440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6c8312e6-e971-46f4-8958-896d379b27d0 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:19.387651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6c8312e6-e971-46f4-8958-896d379b27d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:19.422275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33785a8e-e5fd-45cc-99c3-c7ca27df03e3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:19.465354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:19.466979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.467430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.467891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 350/706] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 11:19:19.468086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.477348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:19.484009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:19.486529 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:19.492269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8312e6-e971-46f4-8958-896d379b27d0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:19.508679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:19.509708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:19.510691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:19.510691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:19.510691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:19.510691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:19.510691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 357/707] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:19.515695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:19.646197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:19.662509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8312e6-e971-46f4-8958-896d379b27d0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:19.670809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44f06b-6d2e-473e-a267-6b0a8567addc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:19.704662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815b8a9-d9fd-4821-b9a6-23a4d6eeb343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:19.705850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815b8a9-d9fd-4821-b9a6-23a4d6eeb343 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.706136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815b8a9-d9fd-4821-b9a6-23a4d6eeb343 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.706546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815b8a9-d9fd-4821-b9a6-23a4d6eeb343 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.707347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815b8a9-d9fd-4821-b9a6-23a4d6eeb343 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:19.709603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815b8a9-d9fd-4821-b9a6-23a4d6eeb343 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:19.714612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59879e-ae96-4ab9-b9c7-65f1c80f2316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:19.715757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59879e-ae96-4ab9-b9c7-65f1c80f2316 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.716177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59879e-ae96-4ab9-b9c7-65f1c80f2316 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.716584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59879e-ae96-4ab9-b9c7-65f1c80f2316 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.717472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59879e-ae96-4ab9-b9c7-65f1c80f2316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:19.717934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59879e-ae96-4ab9-b9c7-65f1c80f2316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:19.719430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59879e-ae96-4ab9-b9c7-65f1c80f2316 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-1815b8a9-d9fd-4821-b9a6-23a4d6eeb343 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:19.725626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:19.726777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:19.727838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:19.732263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 351/708] 10.222.0.66 () {56 vars in 1129 bytes} [Thu Jun 23 11:19:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:19.733625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a7795-75fa-4924-a73c-08bc53de9ad7 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.733909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a7795-75fa-4924-a73c-08bc53de9ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.734189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a7795-75fa-4924-a73c-08bc53de9ad7 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.736764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 352/709] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:19.737710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a7795-75fa-4924-a73c-08bc53de9ad7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:19.743423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 358/710] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:19.744876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd3b42-7a53-4c8b-8f54-99bc20c9925e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.745162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd3b42-7a53-4c8b-8f54-99bc20c9925e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.745435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd3b42-7a53-4c8b-8f54-99bc20c9925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.769435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-97cd3b42-7a53-4c8b-8f54-99bc20c9925e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:19.771543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-97cd3b42-7a53-4c8b-8f54-99bc20c9925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:19.836574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:19.864219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 359/711] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:19.865605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd3b42-7a53-4c8b-8f54-99bc20c9925e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:19.881606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a7795-75fa-4924-a73c-08bc53de9ad7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:19.925590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:19.926048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:19.926426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:19.926669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:19.927528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:19.927832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:19.929257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:19.939135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 353/712] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jun 23 11:19:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:19.939135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:19.957468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:20.003949 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd3b42-7a53-4c8b-8f54-99bc20c9925e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:20.048977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65edbf2-fee5-48cd-9924-6a0b83fcab0b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:20.060798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:20.062245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:20.062670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:20.063509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:20.073952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:20.075903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:20.087972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:20.088945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:20.089321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:20.089689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] PATH_INFO: `/v3/services/network` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:20.090444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:20.092019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:20.095266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:20.096314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:20.097497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:20.099925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 360/713] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:20.100983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:20.107077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:20.108252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:20.109302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:20.111144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 354/714] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:19 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:20.117144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:20.160635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:20.216042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:20.238102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ede1a3-e361-4e9e-ab42-f2071fc0322e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:20.239064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40e6a5-4e85-417a-b30f-a27dd46b16ef None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:20.274832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:20.275687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:20.276152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:20.276521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:20.277526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:20.277926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:20.279619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:20.283070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:20.283907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:20.284332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:20.284782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:20.285732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:20.286206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:20.287735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:20.295005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 355/715] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:20.295750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 361/716] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jun 23 11:19:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:20.300585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:20.301345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:20.430881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ada08-c226-4e92-be44-857c46bb85f3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:20.433485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:20.470550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:20.471231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:20.471509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:20.471785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:20.472633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=bb2aadd5a1204d35a8325b3d56d20b03) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:20.472974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:20.474542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:20.481339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 362/717] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:20 2022] GET /identity/v3/role_assignments?user.id=bb2aadd5a1204d35a8325b3d56d20b03&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:20.565741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfb54d-e7e4-48aa-a7de-e1d6356b3592 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:20.610881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a406c-9d51-4711-8daf-c6f26bbe56ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:20.611628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a406c-9d51-4711-8daf-c6f26bbe56ff None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:20.611904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a406c-9d51-4711-8daf-c6f26bbe56ff None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:20.612175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a406c-9d51-4711-8daf-c6f26bbe56ff None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:20.612981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a406c-9d51-4711-8daf-c6f26bbe56ff None admin] RBAC: Adding query filter params (name=network) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:20.613283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a406c-9d51-4711-8daf-c6f26bbe56ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:20.615649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a406c-9d51-4711-8daf-c6f26bbe56ff None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:20.620987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 356/718] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:20.626580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:20.746531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b86b4-3803-48c6-8eeb-e41456b6f05a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:20.783177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b20047-68b7-4b01-8dc9-a73e95e9abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:20.783847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20047-68b7-4b01-8dc9-a73e95e9abae None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:20.784127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20047-68b7-4b01-8dc9-a73e95e9abae None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:20.784399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b20047-68b7-4b01-8dc9-a73e95e9abae None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:20.785136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20047-68b7-4b01-8dc9-a73e95e9abae None admin] RBAC: Adding query filter params (type=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:20.785440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20047-68b7-4b01-8dc9-a73e95e9abae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:20.787658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b20047-68b7-4b01-8dc9-a73e95e9abae None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:20.792838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 363/719] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:21.001759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6f1e-0a57-4349-9710-a0f4842710f3 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:21.002145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6f1e-0a57-4349-9710-a0f4842710f3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:21.002318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e6f1e-0a57-4349-9710-a0f4842710f3 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:21.003999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 357/720] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:21.010644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e996d-4e4c-49a7-bf06-832caa048a6e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:21.010931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e996d-4e4c-49a7-bf06-832caa048a6e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:21.011210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e996d-4e4c-49a7-bf06-832caa048a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:21.028952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-298e996d-4e4c-49a7-bf06-832caa048a6e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:21.030131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-298e996d-4e4c-49a7-bf06-832caa048a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:21.070556 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:21.118044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 364/721] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:21.153969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6f1e-0a57-4349-9710-a0f4842710f3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:21.158000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:21.302671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e6f1e-0a57-4349-9710-a0f4842710f3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:21.350816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f18182-aa20-4b03-bf5c-79e73e7b8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:21.351962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f18182-aa20-4b03-bf5c-79e73e7b8bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:21.352411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f18182-aa20-4b03-bf5c-79e73e7b8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:21.352876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f18182-aa20-4b03-bf5c-79e73e7b8bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:21.366726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f18182-aa20-4b03-bf5c-79e73e7b8bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-77f18182-aa20-4b03-bf5c-79e73e7b8bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:21.374558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:21.375466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:21.376292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:21.378585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 358/722] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:21.384483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e996d-4e4c-49a7-bf06-832caa048a6e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:21.529448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e996d-4e4c-49a7-bf06-832caa048a6e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:21.555173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d614-03d2-456a-8570-2c5e503adaff None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:21.555413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d614-03d2-456a-8570-2c5e503adaff None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:21.555755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d614-03d2-456a-8570-2c5e503adaff None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:21.557437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 359/723] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:21.566175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91148-17a6-4f70-8f03-205255328562 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:21.566755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91148-17a6-4f70-8f03-205255328562 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:21.566755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d91148-17a6-4f70-8f03-205255328562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:21.574777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:21.575469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:21.575760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:21.576040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:21.576830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:21.577147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:21.578548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:21.587808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-78d91148-17a6-4f70-8f03-205255328562 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:21.589045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-78d91148-17a6-4f70-8f03-205255328562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:21.596408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 365/724] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:21.613931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:21.666959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:21.699120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:21.715723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 360/725] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:21.748957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91148-17a6-4f70-8f03-205255328562 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:21.782966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a99fb-2f5d-4d99-aa8e-21b8d9079bee None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:21.819943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:21.820671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:21.820973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:21.821247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:21.833244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:21.834706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:21.853185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:21.854194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:21.855059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:21.855059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:21.855059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:21.855059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:21.859783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 366/726] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:21.861026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:21.943942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:21.966568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf38fd-19c8-4f05-9e47-edd09ec7f975 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.003134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.003803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.004137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.004557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.005388 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:22.006532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:22.007925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:22.027760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 367/727] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:22.029260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:22.095959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d91148-17a6-4f70-8f03-205255328562 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.139015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e7542-0540-462c-8e77-8cc80e788087 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.176603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.177525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.177823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.178101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.185730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:22.187290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:22.193414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.194485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.194933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.195405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.202298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:22.206070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:22.206965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:22.208266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 368/728] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:22.213725 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:22.221612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:22.222790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:22.223742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 361/729] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:22.226452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:22.237762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:22.340518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a87d2-1360-436c-bf95-d9114e05ecfe None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.377342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.377943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.378225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.378499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.379438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:22.379748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:22.381650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:22.404544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 369/730] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jun 23 11:19:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:22.406555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:22.407590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:22.469304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:22.518667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eddd47f-bd05-4eb8-9fc1-0a8faba5c7a0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.521751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763d8e4-5716-4f16-a017-154bc281555f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.553960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dc9bc-6dd0-4c39-b420-f74b37bc67e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.554710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc9bc-6dd0-4c39-b420-f74b37bc67e6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.554904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc9bc-6dd0-4c39-b420-f74b37bc67e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.555183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc9bc-6dd0-4c39-b420-f74b37bc67e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.594460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.595238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.595430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.595698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.596494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:22.600738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:22.600738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:22.617493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 362/731] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:22.623096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:22.646207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dc9bc-6dd0-4c39-b420-f74b37bc67e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:22.648014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dc9bc-6dd0-4c39-b420-f74b37bc67e6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:22.761449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:22.791493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f5a17-6db5-428e-99e1-f157037fa87e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.811292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:22.812227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 370/732] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:22.814123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5dae-8c29-45c2-a592-31c294f42370 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.814389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5dae-8c29-45c2-a592-31c294f42370 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.814658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5dae-8c29-45c2-a592-31c294f42370 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.816472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 371/733] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:22.817503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5dae-8c29-45c2-a592-31c294f42370 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:22.839224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6551a-3aab-41a3-a289-6c182d8453bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.840036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6551a-3aab-41a3-a289-6c182d8453bb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.840309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6551a-3aab-41a3-a289-6c182d8453bb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.840581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6551a-3aab-41a3-a289-6c182d8453bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.856999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6551a-3aab-41a3-a289-6c182d8453bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:22.858526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6551a-3aab-41a3-a289-6c182d8453bb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-3ac6551a-3aab-41a3-a289-6c182d8453bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:22.884544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:22.885673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:22.886737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:22.886737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:22.886737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:22.886737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:22.889284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 363/734] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:22.891036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c48a-b308-4162-b03d-9cc2d5d48ccb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.891459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c48a-b308-4162-b03d-9cc2d5d48ccb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.891886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0c48a-b308-4162-b03d-9cc2d5d48ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.912970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d7e0c48a-b308-4162-b03d-9cc2d5d48ccb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:22.914353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d7e0c48a-b308-4162-b03d-9cc2d5d48ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:22.939482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5dae-8c29-45c2-a592-31c294f42370 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:22.983950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:22.985208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:22.985590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:22.986043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:22.998574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 364/735] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:22.999383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c48a-b308-4162-b03d-9cc2d5d48ccb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.005824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.007308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:23.049304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:23.050242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:23.051165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:23.051165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:23.051165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:23.051165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:23.055625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 372/736] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:23.056556 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.066380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.122021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.126494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0c48a-b308-4162-b03d-9cc2d5d48ccb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.163315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.163915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.164196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.164468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.165252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:23.165569 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.166941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.171241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f583d-4ea7-46df-887d-baf88120a5cf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.182672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 365/737] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:23.182672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.212511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58498262-4d15-4374-b339-f2b248fad819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.213222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498262-4d15-4374-b339-f2b248fad819 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.213501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498262-4d15-4374-b339-f2b248fad819 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.213772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58498262-4d15-4374-b339-f2b248fad819 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.214489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58498262-4d15-4374-b339-f2b248fad819 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.215865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58498262-4d15-4374-b339-f2b248fad819 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.231594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 373/738] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:23 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:23.232705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff278-ee66-4358-a271-e6c49b91d464 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.233018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff278-ee66-4358-a271-e6c49b91d464 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.233298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff278-ee66-4358-a271-e6c49b91d464 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.236883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 374/739] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:23.236883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff278-ee66-4358-a271-e6c49b91d464 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.316277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938584cb-9916-476b-85f5-f8a58e809f42 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.320242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.361258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788178-6273-469c-985d-81185374ede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.361939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788178-6273-469c-985d-81185374ede1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.362216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788178-6273-469c-985d-81185374ede1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.362485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788178-6273-469c-985d-81185374ede1 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.363205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788178-6273-469c-985d-81185374ede1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:23.363506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788178-6273-469c-985d-81185374ede1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.364606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff278-ee66-4358-a271-e6c49b91d464 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.365168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788178-6273-469c-985d-81185374ede1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.380819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 366/740] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:23.380819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec08492-0e6e-407f-9fa9-f506d6458db5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.380819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec08492-0e6e-407f-9fa9-f506d6458db5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.380819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec08492-0e6e-407f-9fa9-f506d6458db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.397738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0ec08492-0e6e-407f-9fa9-f506d6458db5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:23.399086 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0ec08492-0e6e-407f-9fa9-f506d6458db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:23.409646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.417500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad318254-e2cb-40a1-b53a-e5ccfd9914af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.418836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad318254-e2cb-40a1-b53a-e5ccfd9914af None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.418836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad318254-e2cb-40a1-b53a-e5ccfd9914af None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.418836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad318254-e2cb-40a1-b53a-e5ccfd9914af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.426935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad318254-e2cb-40a1-b53a-e5ccfd9914af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.428420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad318254-e2cb-40a1-b53a-e5ccfd9914af None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ad318254-e2cb-40a1-b53a-e5ccfd9914af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:23.444487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:23.445662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:23.446620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 375/741] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:19:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:23.448088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db81a-625c-4f13-8909-76a5b28ef554 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.448088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db81a-625c-4f13-8909-76a5b28ef554 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.448088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520db81a-625c-4f13-8909-76a5b28ef554 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.452748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 376/742] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:23.452748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db81a-625c-4f13-8909-76a5b28ef554 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.478547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 367/743] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:23.485539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec08492-0e6e-407f-9fa9-f506d6458db5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.557359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520db81a-625c-4f13-8909-76a5b28ef554 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.588272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.595219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec08492-0e6e-407f-9fa9-f506d6458db5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.599092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0305a-8216-431c-9140-b0e943185b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.599910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0305a-8216-431c-9140-b0e943185b10 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.600191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0305a-8216-431c-9140-b0e943185b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.600461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0305a-8216-431c-9140-b0e943185b10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.607584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0305a-8216-431c-9140-b0e943185b10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.609054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0305a-8216-431c-9140-b0e943185b10 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-dca0305a-8216-431c-9140-b0e943185b10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:23.623259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:23.624333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:23.625279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 377/744] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:23.625981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5b374-7abe-4958-9f20-61cd076cfc54 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.626270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5b374-7abe-4958-9f20-61cd076cfc54 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.626548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5b374-7abe-4958-9f20-61cd076cfc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.642024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.642995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.643162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-80b5b374-7abe-4958-9f20-61cd076cfc54 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:23.643552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.643979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.644370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-80b5b374-7abe-4958-9f20-61cd076cfc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:23.645308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:23.645752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.648424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.670878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 368/745] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jun 23 11:19:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:23.672496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.676571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.715586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 378/746] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 11:19:23.716754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5b374-7abe-4958-9f20-61cd076cfc54 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.789828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c97a4-ca2c-44db-ba62-f92668a068b5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.821410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5b374-7abe-4958-9f20-61cd076cfc54 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.827300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.828125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.828412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.828689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.840433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:23.840815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:23.848665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:23.849690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:23.850523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:23.854898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 369/747] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:23.855740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.862626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.863295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.863600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:23.863897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:23.864753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:23.865108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:23.866443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:23.878637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 379/748] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:23.879433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:23.924877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:23.965416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c0ec-29c0-44aa-b38e-4bdd1535442e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.984524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a053fa-db38-4101-93bf-04a8c21ca275 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:23.999018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:23.999673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:23.999951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.000225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.019835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:24.020869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:24.021612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.021899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.022633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.024035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.038188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 380/749] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:23 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:24.039274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.082808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:24.102548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.104948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.172408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178697-4527-4bb9-946c-5365390af8c7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:24.192156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:24.210305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:24.211257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:24.211537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.211806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.212567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:24.212903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.214311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.228926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 381/750] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:24.229869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.252795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 370/751] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 11:19:24.255059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.341392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:24.349992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46c01b-a7b8-4c06-b9f0-3baaa3fb6eb3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:24.369671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fb365-3a3e-4472-a9ff-2eac5ab6addc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:24.389317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:24.389975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:24.390255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.390526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.391462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=954ff9ef0bd54012af73a0b901a7893b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:24.391773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.393241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.399953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 382/752] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/role_assignments?user.id=954ff9ef0bd54012af73a0b901a7893b&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:24.400787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.421538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:24.422418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:24.422703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.422980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.441408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.443089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:24.470468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:24.471437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:24.472330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:24.472330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:24.472330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:24.472330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:24.472330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 371/753] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:24.482021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.522782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:24.604976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fe702-8b1b-4b88-b8c5-2371dd741a47 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:24.652569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:24.653404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:24.653685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.653959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.675743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.677491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.681690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79b5df-0019-4581-8aef-86323867c601 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:24.705707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:24.706628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:24.707566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:24.707566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:24.707566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:24.707566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:24.707566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 383/754] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:24.716382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.735065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:24.745411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:24.746332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:24.746757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.747200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.748085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:24.748534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.750078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.767599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 372/755] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:24.773361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.865162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe00fac-4e3b-4faa-943e-56095af9d2d1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:24.908471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:24.909283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:24.909569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:24.909845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:24.910777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:24.911085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:24.912492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:24.929729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:24.940526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 384/756] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:24.942515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:24.953854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f75f7-f131-4be6-bc93-29e4d71c4c36 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.017676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.018730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.019173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.019588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.031345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.033208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:25.062214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:25.063735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:25.064673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:25.068740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 373/757] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:25.071929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.077026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:25.128820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edbfa9-83ee-443b-bfad-9105e91a3fc4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.192301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.193293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.193576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.193848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.206617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.208459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:25.222437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:25.223422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:25.224311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:25.224751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 385/758] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:25.233345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090e8e9-99cc-40ee-9b8f-27ed6c1d5f65 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.238282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.269473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.270269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.270555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.270827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.271734 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:25.272048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.273580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.277009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:25.292832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 374/759] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:25.298362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.408334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c106-66f0-42ea-825c-e423ec66804f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.444480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58f5e5-8f68-4bab-ad5d-b70d4c1c9716 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.445989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27270d1-78b6-4986-b165-e9c2b28abc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.447005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27270d1-78b6-4986-b165-e9c2b28abc66 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.447352 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27270d1-78b6-4986-b165-e9c2b28abc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.447692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27270d1-78b6-4986-b165-e9c2b28abc66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.459852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27270d1-78b6-4986-b165-e9c2b28abc66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.461526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27270d1-78b6-4986-b165-e9c2b28abc66 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.475730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:25.482314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48463765-adee-4d88-a1d7-c84acf26be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.483065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463765-adee-4d88-a1d7-c84acf26be9b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.483416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463765-adee-4d88-a1d7-c84acf26be9b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.483750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48463765-adee-4d88-a1d7-c84acf26be9b None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e27270d1-78b6-4986-b165-e9c2b28abc66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:25.484456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:25.485458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:25.486349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:25.486349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:25.486349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:25.486349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:25.486563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48463765-adee-4d88-a1d7-c84acf26be9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:25.486563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48463765-adee-4d88-a1d7-c84acf26be9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.486696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 375/760] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:25.492000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48463765-adee-4d88-a1d7-c84acf26be9b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.492147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2916e-ca9d-4ee3-938c-718f33d947fa None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.492147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2916e-ca9d-4ee3-938c-718f33d947fa None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.492147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2916e-ca9d-4ee3-938c-718f33d947fa None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.492147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 376/761] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:25.493200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2916e-ca9d-4ee3-938c-718f33d947fa None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.505011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 386/762] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:25.506325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070411de-48f9-4d53-93fa-b6c0839086ee None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.506605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070411de-48f9-4d53-93fa-b6c0839086ee None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.506878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070411de-48f9-4d53-93fa-b6c0839086ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.526557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-070411de-48f9-4d53-93fa-b6c0839086ee None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:25.527775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-070411de-48f9-4d53-93fa-b6c0839086ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:25.557508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:25.596152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 387/763] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:25.596997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070411de-48f9-4d53-93fa-b6c0839086ee None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.636142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2916e-ca9d-4ee3-938c-718f33d947fa None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.687683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.689597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.690092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.691059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.692382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:25.692911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.695482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.703005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070411de-48f9-4d53-93fa-b6c0839086ee None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.716147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 377/764] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:25.716147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.732317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:25.753416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.754427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.754927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.755388 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.757094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=f47acd9b12ef428c941175dd18ca3029) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:25.758193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.760658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.769081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 388/765] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/role_assignments?user.id=f47acd9b12ef428c941175dd18ca3029&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:25.770660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.840784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ef605-372e-4f14-9088-e55b94ddf32a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.844555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:25.883707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22bc49-e8b8-4f4f-913f-df4c79eeac14 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:25.890519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.892581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.893126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.893592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.894951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.897390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:25.913579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:25.914555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:25.915380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 378/766] 10.222.0.66 () {56 vars in 1129 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:25.921159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:25.941361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:25.942793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:25.942983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:25.943261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:25.962317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:25.963882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:25.993450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:25.994407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:25.995268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 389/767] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:26.002764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:26.061289 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:26.100512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29aef27-b2f5-4c14-876a-d2e1e62ede2d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:26.129419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac438-a615-452c-b3e1-3d4f50ff8308 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:26.194541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:26.195637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.196146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.196617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.197594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:26.198100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:26.199763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:26.206276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 379/768] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jun 23 11:19:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:26.212212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:26.247454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:26.351282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:26.352356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.352630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.352924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.353729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:26.354034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:26.355478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:26.380868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 390/769] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:26.384393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eafa86-4125-4d87-90b5-cc98a574b98f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:26.387871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:26.432171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919e6c3-4fcb-48ae-9b4a-66880e8d0e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:26.432929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e6c3-4fcb-48ae-9b4a-66880e8d0e75 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.433259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e6c3-4fcb-48ae-9b4a-66880e8d0e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.433535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919e6c3-4fcb-48ae-9b4a-66880e8d0e75 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.434256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919e6c3-4fcb-48ae-9b4a-66880e8d0e75 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:26.434633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919e6c3-4fcb-48ae-9b4a-66880e8d0e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:26.436019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919e6c3-4fcb-48ae-9b4a-66880e8d0e75 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:26.443983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 380/770] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jun 23 11:19:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:26.445550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da694a9-11b4-4a8e-946d-8d97be3cb3a2 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.445939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da694a9-11b4-4a8e-946d-8d97be3cb3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.446219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da694a9-11b4-4a8e-946d-8d97be3cb3a2 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.447742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 381/771] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:26.450230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da694a9-11b4-4a8e-946d-8d97be3cb3a2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:26.521499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9c230-189f-4073-b51f-6da7c8a5516d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:26.525203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:26.571095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37575c-30d8-4e99-9b49-ec36aa439f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:26.572290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37575c-30d8-4e99-9b49-ec36aa439f77 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.572575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37575c-30d8-4e99-9b49-ec36aa439f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.572883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37575c-30d8-4e99-9b49-ec36aa439f77 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/bb2aadd5a1204d35a8325b3d56d20b03/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.575734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37575c-30d8-4e99-9b49-ec36aa439f77 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=bb2aadd5a1204d35a8325b3d56d20b03, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:26.576459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:26.579005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37575c-30d8-4e99-9b49-ec36aa439f77 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:26.584446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da694a9-11b4-4a8e-946d-8d97be3cb3a2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:26.597359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 391/772] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:26 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/bb2aadd5a1204d35a8325b3d56d20b03/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:19:26.599140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa5a4b-15f4-4f6a-9310-50c1f69f7904 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.599429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa5a4b-15f4-4f6a-9310-50c1f69f7904 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.599747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa5a4b-15f4-4f6a-9310-50c1f69f7904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.620462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b1aa5a4b-15f4-4f6a-9310-50c1f69f7904 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:26.624794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b1aa5a4b-15f4-4f6a-9310-50c1f69f7904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:26.630425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:26.632052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.632293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.632431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.634239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] RBAC: Adding query filter params (interface=public, service_id=a2514a77caf2464ca790be110c5855cc, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:26.634239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:26.636252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:26.648435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 382/773] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:19:26 2022] GET /identity/v3/endpoints?service_id=a2514a77caf2464ca790be110c5855cc&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:26.657890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:26.713182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 392/774] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:26.760440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa5a4b-15f4-4f6a-9310-50c1f69f7904 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:26.826555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05348-22f1-4734-994d-afce63e8d7ee None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:26.868785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8b9f4-41ec-4879-94e5-e3418029a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:26.869621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b9f4-41ec-4879-94e5-e3418029a3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.869908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b9f4-41ec-4879-94e5-e3418029a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.870656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8b9f4-41ec-4879-94e5-e3418029a3a6 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.871300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b9f4-41ec-4879-94e5-e3418029a3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:26.873172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8b9f4-41ec-4879-94e5-e3418029a3a6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:26.881399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 383/775] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:26 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:26.882675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a126ac-0557-449c-86db-4c226293e2ba None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.882960 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a126ac-0557-449c-86db-4c226293e2ba None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.883232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a126ac-0557-449c-86db-4c226293e2ba None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.884741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 384/776] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:26.890455 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83af9e5-c24b-46d7-950e-c08f1c0f201a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.890776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83af9e5-c24b-46d7-950e-c08f1c0f201a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.891005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83af9e5-c24b-46d7-950e-c08f1c0f201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.898771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:26.913174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b83af9e5-c24b-46d7-950e-c08f1c0f201a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:26.914533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b83af9e5-c24b-46d7-950e-c08f1c0f201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:26.916862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa5a4b-15f4-4f6a-9310-50c1f69f7904 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:26.942764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:26.990405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:26.991484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:26.991907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:26.992341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] PATH_INFO: `/v3/services/network` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:26.993204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:26.994761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:27.019462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:27.020759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:27.021658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:27.022702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 393/777] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:26 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:27.024072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 385/778] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:19:27.030027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.083611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83af9e5-c24b-46d7-950e-c08f1c0f201a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.195361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4f876-a940-454a-85de-e7982e43d67d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:27.230958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83af9e5-c24b-46d7-950e-c08f1c0f201a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:27.270614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:27.272156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:27.272686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:27.273090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:27.283848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:27.291897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:27.293136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:27.293971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:27.294606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:27.294606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:27.294795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 386/779] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:27.294865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:27.294865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:27.295330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] RBAC: Adding query filter params (name=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:27.295630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:27.304789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:27.304949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.311587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 394/780] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:27.317565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.335770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:27.357215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:27.476015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4a11d-11af-4552-9cfd-5fb8398bb39b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:27.494805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7943aa-7513-464f-97ad-6c7daa1bb054 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:27.543859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:27.545040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:27.546237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:27.547237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:27.548255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:27.548889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:27.552408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:27.564219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:27.565183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:27.565610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:27.566027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:27.566925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] RBAC: Adding query filter params (type=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:27.567395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:27.569129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:27.573746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 387/781] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:27.581690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.581948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 395/782] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:27.593653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.673093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:27.692848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187edbe-8a69-4f08-8123-667c60337adc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:27.728298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:27.729460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:27.729955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:27.730618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:27.743019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:27.744860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:27.763384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:27.764351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:27.765361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:27.765361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:27.765361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:27.765361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:27.767774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 388/783] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:27.773798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.790107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:27.831865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ac80d-a327-45b5-abd5-d4934cd4abde None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:27.910502 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:27.911653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:27.912117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:27.912567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:27.913580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] RBAC: Adding query filter params (interface=public, service_id=af5bc747bf804125aa414f726a87c2ee, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:27.914105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:27.915663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:27.933214 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 396/784] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/endpoints?service_id=af5bc747bf804125aa414f726a87c2ee&interface=public®ion_id=RegionOne => generated 194 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:27.939457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:27.954797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6560f-5c5d-439a-be72-f1497267afce None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:27.997208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:28.005793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.006760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.007732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.009050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.011042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:28.011958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:28.014975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:28.061262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 389/785] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:28.070350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:28.135644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64398f37-eb2a-450f-90cb-a2d447e46015 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.173882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fe960-b754-4674-a0c8-38603a67e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.174548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe960-b754-4674-a0c8-38603a67e26e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.174833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe960-b754-4674-a0c8-38603a67e26e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.175109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fe960-b754-4674-a0c8-38603a67e26e None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.175797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fe960-b754-4674-a0c8-38603a67e26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:28.177254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fe960-b754-4674-a0c8-38603a67e26e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:28.183110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 397/786] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:27 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:28.184463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee13e51-2427-4552-9f2d-7f93f0feea8e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.184769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee13e51-2427-4552-9f2d-7f93f0feea8e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.185048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee13e51-2427-4552-9f2d-7f93f0feea8e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.186546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 398/787] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:28.193393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba415-001a-4792-80fc-f2c437bbd7d1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.193664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba415-001a-4792-80fc-f2c437bbd7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.193948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba415-001a-4792-80fc-f2c437bbd7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.226565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d1dba415-001a-4792-80fc-f2c437bbd7d1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:28.229669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d1dba415-001a-4792-80fc-f2c437bbd7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:28.238966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaffc08-6cbb-49d0-b7d7-aef19f899c93 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.248056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:28.337847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.339921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.340201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.340479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.359983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:28.362946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:28.377713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 399/788] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:28.387921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:28.388989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:28.389919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:28.391317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 390/789] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:28.396246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba415-001a-4792-80fc-f2c437bbd7d1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:28.405422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:28.459026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:28.509407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba415-001a-4792-80fc-f2c437bbd7d1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.514644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6aa57-a2d2-4f7c-868f-85bb3ad7084b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.546216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.547064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.547430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.547700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.548826 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:28.549132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:28.549322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.550089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.550370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.550632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:28.550843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.561470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:28.569721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:28.571830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:28.573861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:28.575594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 400/790] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jun 23 11:19:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:28.575745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 391/791] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:28.580781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:28.582025 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:28.582601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:28.678758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07722dc7-cbd0-4a6e-b61d-d61c703c5433 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.685639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06485629-5b3f-4af3-8d2d-491ffa3155fd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.688010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:28.714238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.714923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.715208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.715487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.716239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:28.716548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:28.717958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:28.726304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.727108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.727378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.727645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.731106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 392/792] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:28.732377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:28.740364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:28.742002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:28.763079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:28.765168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:28.767267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:28.767267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:28.767267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:28.767267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:28.767267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 401/793] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:28.773769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:28.886249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:28.891820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec527252-ee66-4998-b73d-52bb32274eed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.957357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:28.958993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:28.959501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:28.959998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:28.971394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:28.973244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:28.974975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2922ed-45e3-42f5-a3ab-3cff45607a0b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:28.991399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:28.992373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:28.993298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:28.993298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:28.993298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:28.993298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:28.995565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 393/794] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:29.000972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.038672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:29.050531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9fb5f-f6a5-4f7d-8cd7-fff5253ca7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.051327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9fb5f-f6a5-4f7d-8cd7-fff5253ca7ed None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.051609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9fb5f-f6a5-4f7d-8cd7-fff5253ca7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.056997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9fb5f-f6a5-4f7d-8cd7-fff5253ca7ed None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.058686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9fb5f-f6a5-4f7d-8cd7-fff5253ca7ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:29.059004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9fb5f-f6a5-4f7d-8cd7-fff5253ca7ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.060636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9fb5f-f6a5-4f7d-8cd7-fff5253ca7ed None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.075461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 402/795] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:29.077116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0bb8-60f3-40c8-87e9-860b3dacea4b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.077506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0bb8-60f3-40c8-87e9-860b3dacea4b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.077882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0bb8-60f3-40c8-87e9-860b3dacea4b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.079454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 403/796] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:29.080355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0bb8-60f3-40c8-87e9-860b3dacea4b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.146538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82af581-66b0-4989-bfc0-45e4d5209288 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.181999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201337-43b7-42da-8c38-6ec959e447a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.182675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201337-43b7-42da-8c38-6ec959e447a7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.182952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201337-43b7-42da-8c38-6ec959e447a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.183223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201337-43b7-42da-8c38-6ec959e447a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.183944 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201337-43b7-42da-8c38-6ec959e447a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:29.184250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201337-43b7-42da-8c38-6ec959e447a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.185663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201337-43b7-42da-8c38-6ec959e447a7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.198982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 394/797] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:29.200394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfc7ab-c4ca-47e1-87e4-e5bb54d93ee0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.200681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfc7ab-c4ca-47e1-87e4-e5bb54d93ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.200984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfc7ab-c4ca-47e1-87e4-e5bb54d93ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.210909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a0bb8-60f3-40c8-87e9-860b3dacea4b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.219477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3bcfc7ab-c4ca-47e1-87e4-e5bb54d93ee0 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:29.220826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3bcfc7ab-c4ca-47e1-87e4-e5bb54d93ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:29.228135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:29.258403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.259862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.260383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.261819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.271046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.273304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:29.290975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:29.291870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:29.292789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:29.294856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 404/798] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:29.295627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.300677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 395/799] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:29.303151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecb30-0f08-429c-b1c2-295ea7b88c33 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.303652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecb30-0f08-429c-b1c2-295ea7b88c33 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.304106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ecb30-0f08-429c-b1c2-295ea7b88c33 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.305874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 396/800] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:29.306754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecb30-0f08-429c-b1c2-295ea7b88c33 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.324845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:29.412686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ecb30-0f08-429c-b1c2-295ea7b88c33 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.418255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba427bb-2233-407a-959d-fdf26347104f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.446978 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c55b63-5d5f-4dcb-aeba-58a1d58c750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.447647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c55b63-5d5f-4dcb-aeba-58a1d58c750c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.447934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c55b63-5d5f-4dcb-aeba-58a1d58c750c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.448214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c55b63-5d5f-4dcb-aeba-58a1d58c750c None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.449054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c55b63-5d5f-4dcb-aeba-58a1d58c750c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:29.449368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c55b63-5d5f-4dcb-aeba-58a1d58c750c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.450829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c55b63-5d5f-4dcb-aeba-58a1d58c750c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.455846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.456928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.457462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.457950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.462831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 397/801] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:29.464207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2b41-ff07-440b-8172-5f7b42fdb2e5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.464631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2b41-ff07-440b-8172-5f7b42fdb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.465061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb2b41-ff07-440b-8172-5f7b42fdb2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.469113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.470717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.481816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-dcfb2b41-ff07-440b-8172-5f7b42fdb2e5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:29.483019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dcfb2b41-ff07-440b-8172-5f7b42fdb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:29.486134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:29.487094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:29.488032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:29.492064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 405/802] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:29.492924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.527469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:29.556238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 398/803] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:29.557026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2b41-ff07-440b-8172-5f7b42fdb2e5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.559179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:29.608432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c705bb-ce6a-46c3-802b-6aab6e02b5a9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.644981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.645633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.646085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.646406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.656631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:29.664334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:29.665304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:29.666135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 406/804] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:29.666824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.670897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb2b41-ff07-440b-8172-5f7b42fdb2e5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.708604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.709553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.709827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.710096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/954ff9ef0bd54012af73a0b901a7893b/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.712054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=954ff9ef0bd54012af73a0b901a7893b, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.713532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.728265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 399/805] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:29 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/954ff9ef0bd54012af73a0b901a7893b/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:29.729445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.796429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:29.806466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23871d6b-c2b8-43e7-9edf-6dd8fadf150d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.823619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:29.857775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.859112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.859591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.860340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.862111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:29.862675 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.865409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.870207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f866e-d741-41b9-81d5-884ba1fe6098 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:29.892057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 407/806] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:29.893769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:29.918141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:29.918981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:29.919264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:29.919541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:29.920206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:29.921683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:29.934081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:29.934999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:29.935811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 400/807] 10.222.0.66 () {56 vars in 1129 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:29.936669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.018995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d2672-ebf1-4118-9a2e-001a85f7002e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.058306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.058901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.059191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.059549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.060320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:30.060948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.062154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.065021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5b9f2-b821-4fba-a785-3f432f3302af None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.072553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 408/808] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:30.077712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.095223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:30.101095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:30.114326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.116104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.116581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.117117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.132627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.134943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:30.158223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:30.159145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:30.160205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:30.160205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:30.160205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:30.160205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:30.164305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 401/809] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:30.165223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.196530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c8b9c-fd42-4e3a-aad0-8b564e55c458 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.236781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.237868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.238448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.238927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.240048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:30.240558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.242206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.247981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 409/810] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:30.248920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.341187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:30.367117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f2d37-195b-4458-b10b-9434f39110fc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.395372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d498f-20fc-461e-98d1-8d7120d38811 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.410362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.411409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.411944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.412225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.413005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:30.413451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.415095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.431009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 410/811] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:30.431956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.436166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.437131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.437525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.437893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.450256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.451953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:30.470984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:30.472535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:30.474697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:30.474697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:30.474697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:30.474697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:30.480744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 402/812] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:30.480744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.511708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:30.547530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0c08a-1c44-49d9-ab05-73b691dc6167 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.587980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.589082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.589624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.590074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.590954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:30.591489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.592064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b991e-20d5-4220-8ff5-3dcde15baa91 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.593343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.599372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 411/813] 10.222.0.66 () {56 vars in 1124 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:30.600614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.603915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:30.632888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.634212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.634544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.634822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.643258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.644893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:30.660094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:30.661089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:30.661955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 403/814] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:30.663102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.713518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225847a1-fd36-499e-83c1-77002fe323c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.749547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d20173-d249-46ed-8874-66d3271bcf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.750309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d20173-d249-46ed-8874-66d3271bcf40 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.750647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d20173-d249-46ed-8874-66d3271bcf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.750929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d20173-d249-46ed-8874-66d3271bcf40 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.751773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d20173-d249-46ed-8874-66d3271bcf40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:30.752084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d20173-d249-46ed-8874-66d3271bcf40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.753492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d20173-d249-46ed-8874-66d3271bcf40 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.754203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:30.764707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3952ff9-b295-4edc-bcf2-fab6e0ed0662 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.767691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 412/815] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:30.768898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087dde5-a9ec-4e40-9ef3-7396245b5d2a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.769185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087dde5-a9ec-4e40-9ef3-7396245b5d2a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.769487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087dde5-a9ec-4e40-9ef3-7396245b5d2a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.771055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 413/816] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:30.775842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087dde5-a9ec-4e40-9ef3-7396245b5d2a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.807726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.808392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.808789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.809066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.809802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.811160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.840775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 404/817] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:19:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:30.840775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:30.850477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:30.915368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087dde5-a9ec-4e40-9ef3-7396245b5d2a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.965375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5d4ed-33ec-4a86-9675-f7b0a10bd1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:30.966342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d4ed-33ec-4a86-9675-f7b0a10bd1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.966631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d4ed-33ec-4a86-9675-f7b0a10bd1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.966911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5d4ed-33ec-4a86-9675-f7b0a10bd1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:30.967903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5d4ed-33ec-4a86-9675-f7b0a10bd1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:30.968562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5d4ed-33ec-4a86-9675-f7b0a10bd1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:30.970470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5d4ed-33ec-4a86-9675-f7b0a10bd1a3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:30.971864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2d89b-d630-4a4f-9262-00f6c1e92369 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:30.988898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 414/818] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:30.990683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17707-a8a1-49b0-8ff8-940b4278f343 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:30.991072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17707-a8a1-49b0-8ff8-940b4278f343 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:30.991441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a17707-a8a1-49b0-8ff8-940b4278f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.009874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-62a17707-a8a1-49b0-8ff8-940b4278f343 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:31.011222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-62a17707-a8a1-49b0-8ff8-940b4278f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:31.018282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:31.019100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:31.019384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:31.019946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.028087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:31.030259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:31.045039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:31.046168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:31.047304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:31.048463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 405/819] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:19:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:31.053607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:31.066173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:31.095294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 415/820] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:31.096135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17707-a8a1-49b0-8ff8-940b4278f343 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:31.156468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:31.196739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be62b1-76d4-4c0c-ad5d-da2cfdf2151e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:31.222416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a17707-a8a1-49b0-8ff8-940b4278f343 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:31.242292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:31.243454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:31.244104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:31.244391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/f47acd9b12ef428c941175dd18ca3029/roles/05a89bc0931e46538d695e23d585c162` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.260870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=f47acd9b12ef428c941175dd18ca3029, role_id=05a89bc0931e46538d695e23d585c162)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:31.262480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:31.268662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:31.269679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:31.269886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:31.270263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.271291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:31.271631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:31.273399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:31.278561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 406/821] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:31 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/f47acd9b12ef428c941175dd18ca3029/roles/05a89bc0931e46538d695e23d585c162 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:31.279900 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:31.301856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 416/822] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:19:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:31.312175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:31.393883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:31.478541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538f1eb-1262-43b3-baf0-6cf98fa246c8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:31.497327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a56ad-3159-48c0-ad6c-c1f5081c4175 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:31.510856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:31.526226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:31.527037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:31.527312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:31.527715 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] PATH_INFO: `/v3/services/network` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.528380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:31.529830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:31.541909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:31.543132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 11:19:31.544126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:31.544904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:31.544904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:31.544904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:31.544904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.545174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 407/823] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:31 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:31.549669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:31.660232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:31.661756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:31.777396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 417/824] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:19:31.782769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:31.795016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cf703-3576-461e-beaa-418f116c4c83 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:31.801110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:31.854494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:31.892160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:31.892881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:31.893162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:31.893433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.896798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c7565-e889-4894-8b1c-9d5bff6fd641 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:31.898680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] RBAC: Adding query filter params (name=network) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:31.898926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:31.909265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:31.915029 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 408/825] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:31.933416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:31.952995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:31.958998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:31.959652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:31.960137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:31.988983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:31.990944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:32.010814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:32.011730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:32.012605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:32.012605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:32.012605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:32.012605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:32.014960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 418/826] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:32.021355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.038276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08d4fa-8178-48b1-bfaa-13de0c8a268d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.076023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c2741-1602-4e69-aa29-6f07de501334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.076767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2741-1602-4e69-aa29-6f07de501334 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.077030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2741-1602-4e69-aa29-6f07de501334 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.077310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c2741-1602-4e69-aa29-6f07de501334 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.078026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2741-1602-4e69-aa29-6f07de501334 None admin] RBAC: Adding query filter params (type=network) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:32.078334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2741-1602-4e69-aa29-6f07de501334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:32.079723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c2741-1602-4e69-aa29-6f07de501334 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.092764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 409/827] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:32.092764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d451f9-3435-455b-a752-a67b826c5aab None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.092764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d451f9-3435-455b-a752-a67b826c5aab None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.092764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d451f9-3435-455b-a752-a67b826c5aab None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.092764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 410/828] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:32.092764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d451f9-3435-455b-a752-a67b826c5aab None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.109015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:32.143857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:32.158023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48648cb8-4e11-46ad-a983-3640996f7a1c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.195641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fa729-30dc-4eac-92ba-27f208ce04af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.196379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d451f9-3435-455b-a752-a67b826c5aab None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.196936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa729-30dc-4eac-92ba-27f208ce04af None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.197450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa729-30dc-4eac-92ba-27f208ce04af None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.198003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa729-30dc-4eac-92ba-27f208ce04af None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.199005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa729-30dc-4eac-92ba-27f208ce04af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:32.199499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa729-30dc-4eac-92ba-27f208ce04af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:32.201084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa729-30dc-4eac-92ba-27f208ce04af None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.219321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 419/829] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:32.221299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f35e-5ab6-4f45-a38e-6eb1451bd23f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.221794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f35e-5ab6-4f45-a38e-6eb1451bd23f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.222282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f35e-5ab6-4f45-a38e-6eb1451bd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.233067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.233818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.234100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.234424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.235200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:32.236879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.243539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3849f35e-5ab6-4f45-a38e-6eb1451bd23f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:32.245147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3849f35e-5ab6-4f45-a38e-6eb1451bd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:32.264871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 411/830] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:19:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:32.264871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.381686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:32.383890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 420/831] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:32.388816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff140cc-b661-40c2-91d2-4b5f8f160026 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.413127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f35e-5ab6-4f45-a38e-6eb1451bd23f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.425093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.426202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.426841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.426841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.435291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:32.436811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:32.454039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:32.455140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:32.456011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:32.459812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 412/832] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:32.461184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.470195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:32.569993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b794cb-c5a7-4721-b5b9-405e372f68ef None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.590497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f35e-5ab6-4f45-a38e-6eb1451bd23f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.615310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.616276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.616655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.616965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.617775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:32.618084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:32.619544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.634460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 413/833] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:32.638657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.639499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.639786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.640061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.641598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.657692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:32.667695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:32.668665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:32.669572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:19:32.670379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:32.671533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 421/834] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:32.679065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.763954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6cb7f-c4e0-4863-9b77-56a65700d385 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.807057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.807897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.808586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.808935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.810064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=bb2aadd5a1204d35a8325b3d56d20b03) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:32.810384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:32.811992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.812690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec08a45-0042-4a03-a5c7-f98943dd7dfc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:32.816348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:32.820332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 414/835] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:32 2022] GET /identity/v3/role_assignments?user.id=bb2aadd5a1204d35a8325b3d56d20b03&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:32.855252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09145841-39ff-4062-9362-6426ff004585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:32.855950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145841-39ff-4062-9362-6426ff004585 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:32.856232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145841-39ff-4062-9362-6426ff004585 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:32.856509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09145841-39ff-4062-9362-6426ff004585 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:32.857352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09145841-39ff-4062-9362-6426ff004585 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:32.857660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09145841-39ff-4062-9362-6426ff004585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:32.859911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09145841-39ff-4062-9362-6426ff004585 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:32.870013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 422/836] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:32.878366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:32.978786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:32.997791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f1467-de8d-49a8-9eae-a07c2a478ac6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.034039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988ac4e-f31e-4ee1-80f8-5740bc8d1add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.034865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ac4e-f31e-4ee1-80f8-5740bc8d1add None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.035239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ac4e-f31e-4ee1-80f8-5740bc8d1add None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.035513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988ac4e-f31e-4ee1-80f8-5740bc8d1add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.048055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988ac4e-f31e-4ee1-80f8-5740bc8d1add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.050417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988ac4e-f31e-4ee1-80f8-5740bc8d1add None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8988ac4e-f31e-4ee1-80f8-5740bc8d1add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:33.074624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:33.075554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:33.076891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:33.076891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:33.076891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:33.076891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:33.076891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 415/837] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:33.083588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09145841-39ff-4062-9362-6426ff004585 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:33.197563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09145841-39ff-4062-9362-6426ff004585 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.208227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c56417-01c0-4f00-9754-e1907631ff1d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.208529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c56417-01c0-4f00-9754-e1907631ff1d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.208805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c56417-01c0-4f00-9754-e1907631ff1d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.210462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 416/838] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:33.215385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570ded-da5c-467e-9944-38bf72512d87 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.215666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570ded-da5c-467e-9944-38bf72512d87 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.215941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570ded-da5c-467e-9944-38bf72512d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.232602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.233240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.233524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.233800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.234525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:33.234833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.235143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-25570ded-da5c-467e-9944-38bf72512d87 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:33.236207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.236384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-25570ded-da5c-467e-9944-38bf72512d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:33.250457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 423/839] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:33.255863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:33.284321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:33.335829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 417/840] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:19:33.352811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25570ded-da5c-467e-9944-38bf72512d87 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:33.374916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521984ef-25b5-46d0-8a29-3df2c60815b3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.419141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.420200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.420475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.420756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.431178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.432616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.433311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:33.454705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:33.455709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 11:19:33.456626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:33.461021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 424/841] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:33.461912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:33.479916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25570ded-da5c-467e-9944-38bf72512d87 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.522781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.524550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.525034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.525511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.526555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.528378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:33.543787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:33.544820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:33.545650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:33.549062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 418/842] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:33.552166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:33.577907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:33.598669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f010f3-d64c-4367-8e3d-58868d83f8ba None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.638735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88e236-27f4-4e17-9b02-47f6c9a366c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.639430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e236-27f4-4e17-9b02-47f6c9a366c0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.639716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e236-27f4-4e17-9b02-47f6c9a366c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.639994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88e236-27f4-4e17-9b02-47f6c9a366c0 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.640864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e236-27f4-4e17-9b02-47f6c9a366c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:33.641179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e236-27f4-4e17-9b02-47f6c9a366c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.642614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88e236-27f4-4e17-9b02-47f6c9a366c0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.660164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 425/843] 10.222.0.66 () {56 vars in 1135 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:33.661509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e5e8-edd7-4e3c-a41b-12bdae0c357b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.661798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e5e8-edd7-4e3c-a41b-12bdae0c357b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.662072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e5e8-edd7-4e3c-a41b-12bdae0c357b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.663444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 426/844] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:33.665729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e5e8-edd7-4e3c-a41b-12bdae0c357b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:33.679745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158bb21-f048-4e98-8859-3f473db96c3c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.713671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:33.720210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c21eba-0fa5-483d-b554-32a923025179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.721162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21eba-0fa5-483d-b554-32a923025179 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.721600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21eba-0fa5-483d-b554-32a923025179 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.721875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21eba-0fa5-483d-b554-32a923025179 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.722651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c21eba-0fa5-483d-b554-32a923025179 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:33.722961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c21eba-0fa5-483d-b554-32a923025179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.724439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c21eba-0fa5-483d-b554-32a923025179 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.729417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 419/845] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:33.730686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14b79-9516-40d4-bf78-087b3766b8d2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.730972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14b79-9516-40d4-bf78-087b3766b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.731250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d14b79-9516-40d4-bf78-087b3766b8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.749714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-13d14b79-9516-40d4-bf78-087b3766b8d2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:33.750927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-13d14b79-9516-40d4-bf78-087b3766b8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:33.779928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122e5e8-edd7-4e3c-a41b-12bdae0c357b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.819013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 420/846] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:33.820150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14b79-9516-40d4-bf78-087b3766b8d2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:33.830373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.831060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.831347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.831626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.849097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:33.908945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.910459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.928551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d14b79-9516-40d4-bf78-087b3766b8d2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:33.953328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:33.966594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:33.967525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:33.967810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:33.968489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:33.969521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:33.969833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:33.972022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:33.989096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 421/847] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:33.989096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.024536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 427/848] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:19:34.025725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.082719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:34.122831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a11ad-1444-409f-9cf1-d65d4aa6612e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.145901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394319b7-5443-42bd-888f-5230e16aa4ce None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.162633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.163871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.164347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.165617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.177605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:34.185605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.186414 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:34.186672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:34.187565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:19:34.188768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:34.189404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.189404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.190888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 422/849] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:19:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:34.196662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.199152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.200610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:34.219438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:34.220370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:34.221295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:34.221295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:34.221295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:34.221295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:34.225070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 428/850] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:34.226593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.256079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:34.310931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f341b-d7da-4e0c-9d96-1a2887d210fe None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.330467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:34.338237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553884c-caa7-4733-82b2-5d24f26e0a14 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.351028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.352093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.352557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.352992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.354104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:34.354601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.356225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.366799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 423/851] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:34.372647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.378353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.379418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.379903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.380524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.381480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:34.382042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.384174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.400307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 429/852] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:34.405686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.493020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c098e-7045-47ff-85f0-e1c5584adab9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.506422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:34.514846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839c89e-434b-4d32-bc8f-2b6f3bdb497c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.536661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.537689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.539314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.539595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.553585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.555058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.557964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.559042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.559517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.559984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.568271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.570092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:34.572703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:34.573587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:34.574477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:34.574477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:34.574477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:34.574477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:34.578824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 424/853] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:34.579687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:34.589717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:34.590588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:34.591468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:34.593755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 430/854] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:34.600250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.625010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:34.699749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb78b7d-ef21-4282-9a1e-6a91b3df2326 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.719732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058f08b-5e82-4d16-8b04-cd003b88808b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.737744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.739028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.739612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.740394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.741619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:34.742138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.743845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.762368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.762368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.762368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.762368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.762787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:34.762787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.762787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.763579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 425/855] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:34.764836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.781139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 431/856] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:34.783434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:34.798801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:34.869760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:34.896654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae777265-555f-4213-8ec2-40cce5ccffdd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.897541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7469da7-21e3-4809-926b-f70a2a37f723 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:34.932372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.933391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.933881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.934399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.935429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=954ff9ef0bd54012af73a0b901a7893b) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:34.935938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.937597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.939394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ca221-e038-45cc-b80c-576b51741e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:34.940403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca221-e038-45cc-b80c-576b51741e91 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:34.940696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca221-e038-45cc-b80c-576b51741e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:34.940996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ca221-e038-45cc-b80c-576b51741e91 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:34.952743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ca221-e038-45cc-b80c-576b51741e91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:34.952743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ca221-e038-45cc-b80c-576b51741e91 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:34.953596 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 432/857] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/role_assignments?user.id=954ff9ef0bd54012af73a0b901a7893b&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-062ca221-e038-45cc-b80c-576b51741e91 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:34.967746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:34.968815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:34.969742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 426/858] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:34.975459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.060408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b695-988f-4323-8e83-d16138a6491b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.060408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b695-988f-4323-8e83-d16138a6491b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.060408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65b695-988f-4323-8e83-d16138a6491b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.064866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 427/859] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:35.068565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5f8ee-9bbc-446c-949b-ffda1f242766 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.068898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5f8ee-9bbc-446c-949b-ffda1f242766 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.069146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5f8ee-9bbc-446c-949b-ffda1f242766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.087646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d0b5f8ee-9bbc-446c-949b-ffda1f242766 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:35.088904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d0b5f8ee-9bbc-446c-949b-ffda1f242766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:35.093184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7282b06-bf41-4be3-a59b-b56189209b72 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:35.138712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:35.139329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.139601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.139840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.140697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:35.141046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:35.142481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:35.154597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:35.167410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 433/860] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jun 23 11:19:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:35.173254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.202533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 428/861] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:35.225278 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5f8ee-9bbc-446c-949b-ffda1f242766 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.241543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:35.286092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5366a13-33ef-46d9-87c9-84ae434b023d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:35.322598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:35.323261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.323603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.323874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.351762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5f8ee-9bbc-446c-949b-ffda1f242766 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:35.392432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:35.393359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.393640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.394267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.395720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:35.397141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:35.397882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:35.403234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:35.404968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:35.412696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:35.413670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:35.414481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:35.416787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 429/862] 10.222.0.66 () {56 vars in 1132 bytes} [Thu Jun 23 11:19:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:35.419869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.526563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:35.540953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 434/863] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 11:19:35.542583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.556444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c8d0e-3686-4704-82b9-8fd903c08592 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:35.600771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:35.601760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.602485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.603225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.604119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:35.604592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:35.606790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:35.617188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 430/864] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:35.619595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.674338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:35.680419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c1ea5-2acb-4c2b-a1b1-3244b6634ffd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:35.724780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:35.725590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.725870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.726175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.740592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:35.742455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:35.749570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a71dbb-e7b3-40d6-ba39-04ca41549f12 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:35.765875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:35.766805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:35.767669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:35.767669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:35.767669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:35.767669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:35.768790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 435/865] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:35.774361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.800092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:35.801618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.801907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.802182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.803476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:35.803837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:35.805546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:35.813230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 431/866] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:35.898146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def826bf-16f8-442d-9c4f-a76df1f36634 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:35.936766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:35.938142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:35.938647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:35.939115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:35.940052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:35.940573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:35.942262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:35.959695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 436/867] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:35.961511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:35.965790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:36.073254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db665ae-6e38-4c7c-b88e-9d21501887eb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:36.107952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690388-3b7d-419f-aff9-e0b3b52e9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:36.108790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690388-3b7d-419f-aff9-e0b3b52e9744 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:36.109071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690388-3b7d-419f-aff9-e0b3b52e9744 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:36.109345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690388-3b7d-419f-aff9-e0b3b52e9744 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:36.116615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690388-3b7d-419f-aff9-e0b3b52e9744 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:36.118137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690388-3b7d-419f-aff9-e0b3b52e9744 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-6b690388-3b7d-419f-aff9-e0b3b52e9744 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:36.132870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:36.133788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:36.134671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:36.138488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 432/868] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:36.140395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:36.156489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e30f-36d7-4d81-b1ec-1287b705efa3 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:36.156840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e30f-36d7-4d81-b1ec-1287b705efa3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:36.157122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e30f-36d7-4d81-b1ec-1287b705efa3 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:36.158704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 433/869] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:36.159256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:36.165214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859ee0-4e9d-490f-83d0-3d584942cdb8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:36.165484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859ee0-4e9d-490f-83d0-3d584942cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:36.165762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859ee0-4e9d-490f-83d0-3d584942cdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:36.183848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-21859ee0-4e9d-490f-83d0-3d584942cdb8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:36.184667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-21859ee0-4e9d-490f-83d0-3d584942cdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:36.251918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:36.263539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 434/870] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:36.267625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecdc57-52cc-4465-87f9-cb1b673c7f15 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:36.284649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21859ee0-4e9d-490f-83d0-3d584942cdb8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:36.304555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794650e-e345-4366-a079-4307145ca584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:36.305344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794650e-e345-4366-a079-4307145ca584 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:36.305694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794650e-e345-4366-a079-4307145ca584 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:36.306037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794650e-e345-4366-a079-4307145ca584 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:36.306937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794650e-e345-4366-a079-4307145ca584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:36.307313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794650e-e345-4366-a079-4307145ca584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:36.308851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794650e-e345-4366-a079-4307145ca584 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:36.327038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 437/871] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:36.329891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794650e-e345-4366-a079-4307145ca584 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:36.410674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21859ee0-4e9d-490f-83d0-3d584942cdb8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:36.418829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:36.453226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdba957-dd19-4c8c-b6a1-00b02b840dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:36.454394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdba957-dd19-4c8c-b6a1-00b02b840dc6 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:36.454779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdba957-dd19-4c8c-b6a1-00b02b840dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:36.455415 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdba957-dd19-4c8c-b6a1-00b02b840dc6 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:36.456255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdba957-dd19-4c8c-b6a1-00b02b840dc6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:36.458263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdba957-dd19-4c8c-b6a1-00b02b840dc6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:36.460563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794650e-e345-4366-a079-4307145ca584 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:36.480851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 435/872] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:36 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:36.514430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1fe2e-c88e-4f92-aa12-14d9712117c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:36.515444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1fe2e-c88e-4f92-aa12-14d9712117c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:36.515866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1fe2e-c88e-4f92-aa12-14d9712117c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:36.516346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1fe2e-c88e-4f92-aa12-14d9712117c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:36.517505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1fe2e-c88e-4f92-aa12-14d9712117c1 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=f47acd9b12ef428c941175dd18ca3029) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:36.518020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1fe2e-c88e-4f92-aa12-14d9712117c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:36.519857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1fe2e-c88e-4f92-aa12-14d9712117c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:36.527583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 438/873] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:36 2022] GET /identity/v3/role_assignments?user.id=f47acd9b12ef428c941175dd18ca3029&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:37.123503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a4ec5-2985-4822-8975-805752c562ba None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:37.123864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a4ec5-2985-4822-8975-805752c562ba None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:37.124056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a4ec5-2985-4822-8975-805752c562ba None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:37.125758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 436/874] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:37.131636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2dff8-ffee-4c53-9c7d-6b3ca8a09617 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:37.131927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2dff8-ffee-4c53-9c7d-6b3ca8a09617 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:37.132203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2dff8-ffee-4c53-9c7d-6b3ca8a09617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:37.149320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8ba2dff8-ffee-4c53-9c7d-6b3ca8a09617 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:37.150527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8ba2dff8-ffee-4c53-9c7d-6b3ca8a09617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:37.224828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 439/875] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:37.242516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a4ec5-2985-4822-8975-805752c562ba None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:37.301641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:37.354145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a4ec5-2985-4822-8975-805752c562ba None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:37.387566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:37.388388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:37.388667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:37.388970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:37.389628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:37.390992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:37.403166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:37.404155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:37.404994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:37.408823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 437/876] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:37.410929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2dff8-ffee-4c53-9c7d-6b3ca8a09617 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:37.471662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:37.514467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2dff8-ffee-4c53-9c7d-6b3ca8a09617 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:37.548707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a471b60-9b92-4958-91b1-fffff7ff6e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:37.549408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a471b60-9b92-4958-91b1-fffff7ff6e6c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:37.549688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a471b60-9b92-4958-91b1-fffff7ff6e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:37.549961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a471b60-9b92-4958-91b1-fffff7ff6e6c None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:37.550691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a471b60-9b92-4958-91b1-fffff7ff6e6c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:37.550996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a471b60-9b92-4958-91b1-fffff7ff6e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:37.552358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a471b60-9b92-4958-91b1-fffff7ff6e6c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:37.557368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 440/877] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:37.563250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:37.670824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b8aeb-fa1f-49d5-8f9f-be4e1ed469a4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:37.690255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:37.707951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9a402-d43a-4581-afb1-4c4f3f91e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:37.708637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9a402-d43a-4581-afb1-4c4f3f91e672 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:37.708946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9a402-d43a-4581-afb1-4c4f3f91e672 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:37.709222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9a402-d43a-4581-afb1-4c4f3f91e672 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:37.709940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9a402-d43a-4581-afb1-4c4f3f91e672 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:37.710246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9a402-d43a-4581-afb1-4c4f3f91e672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:37.711627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9a402-d43a-4581-afb1-4c4f3f91e672 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:37.720913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 438/878] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:38.005158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83954267-fd9f-4bdb-bf9c-c65e6d5cf173 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.005573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83954267-fd9f-4bdb-bf9c-c65e6d5cf173 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.005751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83954267-fd9f-4bdb-bf9c-c65e6d5cf173 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.007353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 441/879] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:38.012508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88dd8b-54f2-4e32-adfe-cb2c3a3a7e12 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.012824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88dd8b-54f2-4e32-adfe-cb2c3a3a7e12 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.013103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88dd8b-54f2-4e32-adfe-cb2c3a3a7e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.030223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-dc88dd8b-54f2-4e32-adfe-cb2c3a3a7e12 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:38.031423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dc88dd8b-54f2-4e32-adfe-cb2c3a3a7e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:38.099902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 439/880] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:38.122960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83954267-fd9f-4bdb-bf9c-c65e6d5cf173 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:38.229751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83954267-fd9f-4bdb-bf9c-c65e6d5cf173 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:38.254660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:38.267179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbefc2-47d6-4db0-99db-7832414b13fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:38.267787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbefc2-47d6-4db0-99db-7832414b13fc None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.268067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbefc2-47d6-4db0-99db-7832414b13fc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.268341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbefc2-47d6-4db0-99db-7832414b13fc None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.269139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbefc2-47d6-4db0-99db-7832414b13fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:38.270507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbefc2-47d6-4db0-99db-7832414b13fc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:38.288779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 442/881] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:38 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:38.615291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5ad17-b310-428a-a4be-3ac3221d0920 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.615291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5ad17-b310-428a-a4be-3ac3221d0920 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.615291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5ad17-b310-428a-a4be-3ac3221d0920 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.615291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 440/882] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:38.623150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f2cc-0371-4176-83b8-31e3fde12bbe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.623150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f2cc-0371-4176-83b8-31e3fde12bbe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.623150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f2cc-0371-4176-83b8-31e3fde12bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.639329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9142f2cc-0371-4176-83b8-31e3fde12bbe None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:38.640861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9142f2cc-0371-4176-83b8-31e3fde12bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:38.715499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 443/883] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:38.724976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dae7b-5915-4345-b473-9bad873f7c3d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.725282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dae7b-5915-4345-b473-9bad873f7c3d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.725567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dae7b-5915-4345-b473-9bad873f7c3d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.728107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 441/884] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:38.732384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d4051-aca5-4ec2-8f32-7dbd1db80c77 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.732673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d4051-aca5-4ec2-8f32-7dbd1db80c77 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.732967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d4051-aca5-4ec2-8f32-7dbd1db80c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.745692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dae7b-5915-4345-b473-9bad873f7c3d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:38.751632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-409d4051-aca5-4ec2-8f32-7dbd1db80c77 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:38.753135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-409d4051-aca5-4ec2-8f32-7dbd1db80c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:38.837411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 444/885] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:38.861441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d4051-aca5-4ec2-8f32-7dbd1db80c77 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:38.885918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dae7b-5915-4345-b473-9bad873f7c3d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:38.903409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:38.908193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:38.931381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:38.932687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:38.933245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:38.933710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:38.934727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:38.936357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:38.950164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:38.951185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:38.951996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:38.954975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 442/886] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:38.961405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:38.980174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d4051-aca5-4ec2-8f32-7dbd1db80c77 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.024627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.025563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.025907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.026240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.040237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:39.050418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:39.051403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:39.052208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:39.057122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 445/887] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jun 23 11:19:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:39.062032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.095044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df665df-0296-4581-9114-4582efdd0c5e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.131266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.132032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.132374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.132736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.133775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:39.134143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.136498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.142761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 443/888] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:39.147980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.169572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:39.173509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef1cc3-a66d-418f-a24f-7bae58c42f4d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.203410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:39.210976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.211793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.212149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.212542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.213419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:39.213816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.215333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.224542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 446/889] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:39.229908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.280821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac8e73-0078-4e5a-baea-e0ddbc7c5a38 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.317178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17850278-e784-47ce-b934-f4a907862787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.318084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17850278-e784-47ce-b934-f4a907862787 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.318196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17850278-e784-47ce-b934-f4a907862787 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.318404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17850278-e784-47ce-b934-f4a907862787 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.319109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17850278-e784-47ce-b934-f4a907862787 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:39.319416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17850278-e784-47ce-b934-f4a907862787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.320936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17850278-e784-47ce-b934-f4a907862787 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.326433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 444/890] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:39.332062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17850278-e784-47ce-b934-f4a907862787 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.350748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20ff80-f8ca-480d-a839-a3d2e5f10127 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.386313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.387169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.387387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.387658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.399497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.400838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:39.419452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:39.420369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:39.421285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:39.421285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:39.421285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:39.421285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:39.421285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 447/891] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:39.427160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.444341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:39.465018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17850278-e784-47ce-b934-f4a907862787 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.469414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:39.517311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.517988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.518268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.518539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.519519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] RBAC: Adding query filter params (interface=public, service_id=c89b22f290aa457fa2b17bf3014cfb8c, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:39.519831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.521487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.527450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 445/892] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/endpoints?service_id=c89b22f290aa457fa2b17bf3014cfb8c&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:39.532450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.545158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08f803-f7c3-44d4-8b91-859eb8253e16 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.581494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.582484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.582835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.583175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.584014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:39.584367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.585890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.605378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 448/893] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:39.606635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.659250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4ab20-ceab-4e07-8c4b-99c099768495 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.689759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:39.702984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.703667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.703949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.704224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.705047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.706429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.713183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 446/894] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:19:39.721776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb300699-5f91-47a0-b2e8-f474c18c2012 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.762757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19a8f2-c7b3-404a-ba98-5c409ba3596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.763979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a8f2-c7b3-404a-ba98-5c409ba3596e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.764519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a8f2-c7b3-404a-ba98-5c409ba3596e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.765136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19a8f2-c7b3-404a-ba98-5c409ba3596e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.774587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a8f2-c7b3-404a-ba98-5c409ba3596e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.776115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19a8f2-c7b3-404a-ba98-5c409ba3596e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2b19a8f2-c7b3-404a-ba98-5c409ba3596e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:39.792822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:39.793820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:39.794737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 449/895] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:39.800558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.827128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb8e1-a535-4326-a9be-e033c806121f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.827726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb8e1-a535-4326-a9be-e033c806121f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.828010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cb8e1-a535-4326-a9be-e033c806121f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.830244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 450/896] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:39.836018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a8945-7d22-4452-a863-83a3d33a7650 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.836313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a8945-7d22-4452-a863-83a3d33a7650 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.836576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a8945-7d22-4452-a863-83a3d33a7650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.839374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:39.855338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5e8a8945-7d22-4452-a863-83a3d33a7650 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:39.856555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e8a8945-7d22-4452-a863-83a3d33a7650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:39.917983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e67f8-d3ed-4eaf-ac35-66657de11a17 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:39.942141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 451/897] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:19:39.955910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:39.957055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:39.957531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:39.958014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:39.959074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:39.959569 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:39.961419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:39.965498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a8945-7d22-4452-a863-83a3d33a7650 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:39.980348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 447/898] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:39.987163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:40.037200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:40.086784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a8945-7d22-4452-a863-83a3d33a7650 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:40.097498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:40.113166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b61b72-1713-4591-b079-09bc9454442b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:40.124606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:40.125349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.125628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.125900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.126654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:40.128005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:40.152742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 452/899] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:39 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:40.167539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e71df-dd66-423d-b0d1-3a8175f842a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:40.168336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e71df-dd66-423d-b0d1-3a8175f842a2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.168563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e71df-dd66-423d-b0d1-3a8175f842a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.168967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e71df-dd66-423d-b0d1-3a8175f842a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.250148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e71df-dd66-423d-b0d1-3a8175f842a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:40.251714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e71df-dd66-423d-b0d1-3a8175f842a2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:40.343891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:40.361775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 448/900] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:39 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:19:40.367620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:40.403200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad208ddc-179e-4357-bf15-aee079b67a84 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.403493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad208ddc-179e-4357-bf15-aee079b67a84 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.403771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad208ddc-179e-4357-bf15-aee079b67a84 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.405453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 449/901] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:40.411963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66291db-11c1-4011-95d0-14f81657fa2c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.412448 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66291db-11c1-4011-95d0-14f81657fa2c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.412909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66291db-11c1-4011-95d0-14f81657fa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.433209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b66291db-11c1-4011-95d0-14f81657fa2c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:40.435182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b66291db-11c1-4011-95d0-14f81657fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:40.493353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861abea4-a4f9-4e08-83f9-f3878ff2d667 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:40.518195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 450/902] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:19:40.532275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:40.533111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.533397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.533670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.537036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:40.539123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66291db-11c1-4011-95d0-14f81657fa2c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:40.550964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:40.552782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:40.570966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:40.571856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:40.572776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:40.572776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:40.572776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:40.572776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:40.574974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 453/903] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:40.584464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:40.663136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66291db-11c1-4011-95d0-14f81657fa2c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:40.683788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:40.684470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae78ee6-9af5-4622-8a92-af687717e6e7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:40.707292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:40.708628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.709201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.709481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.710367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:40.712394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:40.722370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:40.723035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.723316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.723586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.724325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:40.724628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:40.726021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:40.726243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:40.727149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:40.727973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:40.728784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 451/904] 10.222.0.66 () {56 vars in 1132 bytes} [Thu Jun 23 11:19:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:40.738073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:40.748972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 454/905] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:40.750272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:40.793646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:40.852662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa0ba7-2606-40f1-b0ad-1510cc8b72c3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:40.878886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb397d-1ddc-4c36-ad53-09e65c3bf709 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:40.888762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:40.889375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.889658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.889924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.890660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:40.890982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:40.892546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:40.903904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 452/906] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:40.905388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:40.924131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:40.925485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:40.925769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:40.926043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:40.937368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:40.940298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:40.957928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:40.960115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:40.961811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:40.963157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 455/907] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:40.968419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:41.021293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce76ae-50c2-4ba5-b44e-f6f5161b4f75 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:41.062070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:41.062070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:41.062372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:41.062980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:41.063704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:41.064011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:41.065440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:41.076525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 453/908] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:41.077575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:41.093466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:41.100776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d933-a687-4409-adec-2449f035bcc2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:41.152412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:41.153110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:41.153391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:41.153664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:41.154458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:41.154778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:41.156209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:41.169081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 456/909] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:41.174736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:41.203714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b25fa9-48c9-459d-9ed8-4b45dd38b27b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:41.217365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:41.249931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:41.250609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:41.250891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:41.251160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:41.251952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] RBAC: Adding query filter params (interface=public, service_id=da677162f38d4dfc9c6028a1e4c36da6, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:41.252265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:41.253863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:41.262287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 454/910] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:19:41 2022] GET /identity/v3/endpoints?service_id=da677162f38d4dfc9c6028a1e4c36da6&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:41.270030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:41.293542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6220a92-c6da-4220-aaeb-892d6acc6448 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:41.340757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988e533-a6ea-4b12-9372-30c66fd38fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:41.341913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e533-a6ea-4b12-9372-30c66fd38fce None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:41.342592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e533-a6ea-4b12-9372-30c66fd38fce None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:41.343030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e533-a6ea-4b12-9372-30c66fd38fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:41.344649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988e533-a6ea-4b12-9372-30c66fd38fce None admin] RBAC: Adding query filter params (role.id=52ea0a3c3a88492189b9638b329341fd, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=f47acd9b12ef428c941175dd18ca3029) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:41.345121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988e533-a6ea-4b12-9372-30c66fd38fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:41.346975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988e533-a6ea-4b12-9372-30c66fd38fce None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:41.356110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 457/911] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:41 2022] GET /identity/v3/role_assignments?user.id=f47acd9b12ef428c941175dd18ca3029&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=52ea0a3c3a88492189b9638b329341fd => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:41.391049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c67503-95bf-4032-ab93-444f4f722dc8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:41.430904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0e203-77e5-4b68-b97f-160712ea28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:41.431612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e203-77e5-4b68-b97f-160712ea28cb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:41.431898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e203-77e5-4b68-b97f-160712ea28cb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:41.432176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0e203-77e5-4b68-b97f-160712ea28cb None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:41.432944 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e203-77e5-4b68-b97f-160712ea28cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:41.434377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0e203-77e5-4b68-b97f-160712ea28cb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:41.442469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 455/912] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:41 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:19:41.850257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adbf05-a759-40eb-9fba-8afe16a6c38b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:41.850825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adbf05-a759-40eb-9fba-8afe16a6c38b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:41.851096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adbf05-a759-40eb-9fba-8afe16a6c38b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:41.852938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 458/913] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:41.858334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269fa0-d798-4813-b6f2-650ffd3db8be None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:41.858751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269fa0-d798-4813-b6f2-650ffd3db8be None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:41.859097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71269fa0-d798-4813-b6f2-650ffd3db8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:41.877063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-71269fa0-d798-4813-b6f2-650ffd3db8be None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:41.878320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-71269fa0-d798-4813-b6f2-650ffd3db8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:41.908601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:41.950291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 456/914] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:41.973392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adbf05-a759-40eb-9fba-8afe16a6c38b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:42.002650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:42.085278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adbf05-a759-40eb-9fba-8afe16a6c38b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:42.121567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad01f05-f3f8-4f9b-b5b7-03787d7c65d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:42.122298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01f05-f3f8-4f9b-b5b7-03787d7c65d6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.122574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01f05-f3f8-4f9b-b5b7-03787d7c65d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.122841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01f05-f3f8-4f9b-b5b7-03787d7c65d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.123493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad01f05-f3f8-4f9b-b5b7-03787d7c65d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:42.124959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad01f05-f3f8-4f9b-b5b7-03787d7c65d6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-bad01f05-f3f8-4f9b-b5b7-03787d7c65d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:42.136890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:42.137960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:42.138915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 459/915] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:42.144463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71269fa0-d798-4813-b6f2-650ffd3db8be None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:42.244413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71269fa0-d798-4813-b6f2-650ffd3db8be None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:42.253750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb33d-0194-4043-a48e-e26328a05c11 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.254041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb33d-0194-4043-a48e-e26328a05c11 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.254298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cb33d-0194-4043-a48e-e26328a05c11 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.255960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 460/916] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:42.260931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb60ee-42e2-4df7-876d-e62421cc6f29 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.261213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb60ee-42e2-4df7-876d-e62421cc6f29 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.261488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb60ee-42e2-4df7-876d-e62421cc6f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.278550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-aadb60ee-42e2-4df7-876d-e62421cc6f29 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:42.279952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aadb60ee-42e2-4df7-876d-e62421cc6f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:42.281022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:42.282021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.282561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.283130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.284078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:42.284624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:42.286389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:42.292209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 457/917] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:42.298217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:42.335834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:42.363186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 461/918] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:42.385478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb60ee-42e2-4df7-876d-e62421cc6f29 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:42.403906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:42.419869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2802f-c58c-4e7d-9745-41b2bf5bfdeb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:42.456838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:42.457614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.457896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.458171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.458881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:42.459292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:42.460779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:42.466579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 458/919] 10.222.0.66 () {56 vars in 1114 bytes} [Thu Jun 23 11:19:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:42.473476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:42.516824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb60ee-42e2-4df7-876d-e62421cc6f29 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:42.561344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:42.563113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.563502 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.563779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.564674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:42.566532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:42.574668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:42.583760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:42.584782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:42.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:42.586981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4628-8a4f-4504-ade1-907c762591bb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:42.590324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 462/920] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:42.591279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:42.622434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:42.623111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.623391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.623663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.624416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:42.625811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:42.653092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 459/921] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:19:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:42.689720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:42.716062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7e0b7-0d93-427b-b026-95da635081e1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:42.762102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:42.763010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.763346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.763742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.764461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:42.764839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:42.766503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:42.773789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 463/922] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:42.779970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:42.888645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185d49d-c786-4697-96ce-9bea02be8501 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:42.924144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:42.924830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:42.925227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:42.925505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:42.926213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:42.926521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:42.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:42.933564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 460/923] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:42.939582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:43.042444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca873e-7ca2-471c-8d6f-54fa91933e19 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:43.077603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dcdb5-1194-47bf-9d7a-4e15e9ebbf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:43.078267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcdb5-1194-47bf-9d7a-4e15e9ebbf04 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.078543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcdb5-1194-47bf-9d7a-4e15e9ebbf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.078819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcdb5-1194-47bf-9d7a-4e15e9ebbf04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.079606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dcdb5-1194-47bf-9d7a-4e15e9ebbf04 None admin] RBAC: Adding query filter params (interface=public, service_id=bba5d4e1d32f4eacbdb4a460797b5cc2, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:43.079911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dcdb5-1194-47bf-9d7a-4e15e9ebbf04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:43.081632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dcdb5-1194-47bf-9d7a-4e15e9ebbf04 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:43.087149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 464/924] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:19:42 2022] GET /identity/v3/endpoints?service_id=bba5d4e1d32f4eacbdb4a460797b5cc2&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:43.092608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:43.109606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:43.199024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad62ba4-a870-4a81-b58f-c07625d88554 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:43.234281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78c08-3c6b-4f4b-b9fe-8641104c7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:43.235010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78c08-3c6b-4f4b-b9fe-8641104c7095 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.235290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78c08-3c6b-4f4b-b9fe-8641104c7095 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.235563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78c08-3c6b-4f4b-b9fe-8641104c7095 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.236300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e78c08-3c6b-4f4b-b9fe-8641104c7095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:43.238040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e78c08-3c6b-4f4b-b9fe-8641104c7095 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:43.244793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 461/925] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:43 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:19:43.463082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277954-0b71-4091-983c-b6985c991223 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.463082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277954-0b71-4091-983c-b6985c991223 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.463082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277954-0b71-4091-983c-b6985c991223 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.463082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 465/926] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:43.471157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972d246-3eaf-422c-a877-f928eae053d9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.471157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972d246-3eaf-422c-a877-f928eae053d9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.471157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972d246-3eaf-422c-a877-f928eae053d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.488141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a972d246-3eaf-422c-a877-f928eae053d9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:43.489739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a972d246-3eaf-422c-a877-f928eae053d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:43.563552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 462/927] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:43.582749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad277954-0b71-4091-983c-b6985c991223 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:43.586079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:43.593548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ccfe-63c7-41dd-a7c6-8f9fd0d5ab4e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.593838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ccfe-63c7-41dd-a7c6-8f9fd0d5ab4e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.594124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ccfe-63c7-41dd-a7c6-8f9fd0d5ab4e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.595743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 463/928] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:43.600746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67e0b-835f-4b31-b941-7efa4bf7aca0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.603150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67e0b-835f-4b31-b941-7efa4bf7aca0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.603150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f67e0b-835f-4b31-b941-7efa4bf7aca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.618547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f8f67e0b-835f-4b31-b941-7efa4bf7aca0 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:43.620090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f8f67e0b-835f-4b31-b941-7efa4bf7aca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:43.622354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:43.696856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 464/929] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:19:43.700849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad277954-0b71-4091-983c-b6985c991223 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:43.714981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67e0b-835f-4b31-b941-7efa4bf7aca0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:43.741796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:43.742570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.742847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.743166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.755754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:43.764466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:43.765408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:43.766254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 466/930] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jun 23 11:19:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:43.771879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:43.826367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f67e0b-835f-4b31-b941-7efa4bf7aca0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:43.850497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:43.865425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:43.866281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.866558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.866831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.867531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:43.869176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:43.882473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:43.883462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:43.884282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 465/931] 10.222.0.66 () {56 vars in 1132 bytes} [Thu Jun 23 11:19:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:43.898627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:43.900144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963f2ef-c6ba-472a-bdca-b89772db9ede None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:43.905075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:43.944149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:43.944950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:43.945236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:43.945510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:43.947115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:43.947437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:43.948879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:43.960492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 467/932] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jun 23 11:19:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:43.966126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.036549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6b5e-57f8-4135-a955-9816d129a5f6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.084548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.085488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.085997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.086459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.087350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:44.087846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.089464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.099069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684b9f-be42-493b-9a95-1bf11edde732 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.099644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 466/933] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:44.100693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.121594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:44.134650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.135503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.135780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.136050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.147328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.148829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:44.167686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:44.168592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:44.169592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:44.169592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:44.169592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:44.169592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:44.174176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 468/934] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:44.175450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.189070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:44.208290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f980b20-5c8d-47d3-a2d5-8ccf0ab44936 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.250456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.251376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.251805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.252335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.253316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:44.253772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.255882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.262364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 467/935] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:44.268112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.287570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0885-db61-4b37-9f01-3d8d08a1eedd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.327930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.328957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.329402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.329740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.330557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:44.330937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.333244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.350666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 469/936] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:44.356659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.398310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:44.399843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6827b5-2a5a-496c-965c-084cdcde617b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.433454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:44.442246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.443299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.443846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.444326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.445498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.447179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.468760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63c4fc-faec-4a6f-9444-b77dfefc6859 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.471112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 468/937] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:19:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:44.520977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.522171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.522713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.523197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.531989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.533940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:44.552055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:44.553113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:44.554060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:44.560737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 470/938] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:19:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:44.564679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.677689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29111b-7a59-4d7a-af1f-a2217cbcfcfb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.713054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85058e7-6bc8-4772-99df-4f4c3a81bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.713743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85058e7-6bc8-4772-99df-4f4c3a81bec1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.714024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85058e7-6bc8-4772-99df-4f4c3a81bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.714474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85058e7-6bc8-4772-99df-4f4c3a81bec1 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.715385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85058e7-6bc8-4772-99df-4f4c3a81bec1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:44.715697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85058e7-6bc8-4772-99df-4f4c3a81bec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.717225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85058e7-6bc8-4772-99df-4f4c3a81bec1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.739966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 469/939] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jun 23 11:19:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:44.741441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.837146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76816c8-68f7-44a4-b766-a8d8b6e67219 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.837324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76816c8-68f7-44a4-b766-a8d8b6e67219 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.837592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76816c8-68f7-44a4-b766-a8d8b6e67219 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.838764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:44.839221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 470/940] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:44.844617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375474-36ba-4821-a8b6-b139bf0dbe4b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.844934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375474-36ba-4821-a8b6-b139bf0dbe4b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.845210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c375474-36ba-4821-a8b6-b139bf0dbe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.850787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc9c78-db18-4604-90c9-5a271f0df66b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:44.863549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0c375474-36ba-4821-a8b6-b139bf0dbe4b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:44.864749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0c375474-36ba-4821-a8b6-b139bf0dbe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:44.890495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:44.891305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:44.891598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:44.891857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:44.902558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:44.904207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:44.915065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:44.932753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:44.933838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:44.934701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:44.934701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:44.934701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:44.934701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:44.934701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 471/941] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:44.934701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:44.960759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 471/942] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:44.982713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c375474-36ba-4821-a8b6-b139bf0dbe4b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.047642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe218b-c650-43d3-8caf-564822954d26 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.088993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.089996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.090475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.090973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.091910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:45.092422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.094020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.110912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c375474-36ba-4821-a8b6-b139bf0dbe4b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.111285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 472/943] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:45.112881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.117048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:45.151177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.151859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.152130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.152404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.154033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.155481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.156880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING keystone.server.flask.common [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 11:19:45.180091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.sql.core [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 11:19:45.180091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 11:19:45.180091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [parameters: {'id': '3261147edac2491d8197dce455a5affc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 11:19:45.180091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3261147edac2491d8197dce455a5affc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3261147edac2491d8197dce455a5affc. Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:19:45.187855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 11:19:45.188660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application yield resource Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise self.value Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application session.commit() Jun 23 11:19:45.189649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.flush() Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application compat.raise_( Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 11:19:45.190523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 11:19:45.191549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:19:45.192334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [parameters: {'id': '3261147edac2491d8197dce455a5affc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.194764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:45.196652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3261147edac2491d8197dce455a5affc. Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 472/944] 10.222.0.66 () {60 vars in 1140 bytes} [Thu Jun 23 11:19:44 2022] POST /identity/v3/projects => generated 262 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:45.198983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.236767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:45.247560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1e7c9-b514-4c1d-8531-f14f3548716a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.296064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8135a-8346-4493-8875-4dd9ba0bfb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.297015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8135a-8346-4493-8875-4dd9ba0bfb83 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.297355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8135a-8346-4493-8875-4dd9ba0bfb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.297622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8135a-8346-4493-8875-4dd9ba0bfb83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.305101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8135a-8346-4493-8875-4dd9ba0bfb83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.306559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8135a-8346-4493-8875-4dd9ba0bfb83 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.319413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca428f2a-bf04-40a5-a71e-32cacbeccb74 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-94d8135a-8346-4493-8875-4dd9ba0bfb83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:45.321094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:45.321964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:45.322824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 473/945] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:45.323684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2fa89-2eaa-415f-a0b7-c89dea4b73bb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.323760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2fa89-2eaa-415f-a0b7-c89dea4b73bb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.324012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2fa89-2eaa-415f-a0b7-c89dea4b73bb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.325452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 474/946] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:45.327607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2fa89-2eaa-415f-a0b7-c89dea4b73bb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.365079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82da9c-a2ad-4917-bc87-fcec8d27b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.365918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82da9c-a2ad-4917-bc87-fcec8d27b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.366267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82da9c-a2ad-4917-bc87-fcec8d27b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.366549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82da9c-a2ad-4917-bc87-fcec8d27b4b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.373205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82da9c-a2ad-4917-bc87-fcec8d27b4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.374863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82da9c-a2ad-4917-bc87-fcec8d27b4b6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-fe82da9c-a2ad-4917-bc87-fcec8d27b4b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:45.388997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:45.389981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:45.391358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 473/947] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:45.391861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8ca77-df9a-435e-8615-18ff6b5482a1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.392120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8ca77-df9a-435e-8615-18ff6b5482a1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.392399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8ca77-df9a-435e-8615-18ff6b5482a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.404828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:45.409505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-95d8ca77-df9a-435e-8615-18ff6b5482a1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:45.411160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-95d8ca77-df9a-435e-8615-18ff6b5482a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:45.446232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2fa89-2eaa-415f-a0b7-c89dea4b73bb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.479279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 474/948] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:45.480314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8ca77-df9a-435e-8615-18ff6b5482a1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.491251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.492164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.492619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.493099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.494187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:45.494514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.495935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.507921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:45.511907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 475/949] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:45.516760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.591526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8ca77-df9a-435e-8615-18ff6b5482a1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.623709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fc378-8654-4634-9076-c9713d75c3b5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.627313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.627982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.628469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.629161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.629919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:45.630225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.631663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.652743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 475/950] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:45.653054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.658079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:45.676481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d918-9808-4a91-806e-cda859777146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.677628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d918-9808-4a91-806e-cda859777146 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.678002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d918-9808-4a91-806e-cda859777146 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.678405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016d918-9808-4a91-806e-cda859777146 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.679188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016d918-9808-4a91-806e-cda859777146 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.681468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016d918-9808-4a91-806e-cda859777146 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2016d918-9808-4a91-806e-cda859777146 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:45.695771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:45.697088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:45.697950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:45.698690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 476/951] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:45.704642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d918-9808-4a91-806e-cda859777146 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:45.752731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:45.777737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100e319-76cc-42f2-a6d5-aa60ca3dfdfd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.822034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.822994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.823241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.823517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/f47acd9b12ef428c941175dd18ca3029/roles/52ea0a3c3a88492189b9638b329341fd` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.826074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=f47acd9b12ef428c941175dd18ca3029, role_id=52ea0a3c3a88492189b9638b329341fd)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.827561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.836101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016d918-9808-4a91-806e-cda859777146 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:45.848167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 476/952] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:19:45 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/f47acd9b12ef428c941175dd18ca3029/roles/52ea0a3c3a88492189b9638b329341fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:45.881911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:45.882905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:45.883375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:45.883813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:45.884702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:45.885205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:45.887309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:45.893635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 477/953] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:45.899918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:46.017694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2c8e6-2b14-4763-8dda-4c72adbc628c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:46.056664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a130de9-235f-4ab8-a0cb-9e63f4b56995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:46.057380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130de9-235f-4ab8-a0cb-9e63f4b56995 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:46.057662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130de9-235f-4ab8-a0cb-9e63f4b56995 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:46.057938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a130de9-235f-4ab8-a0cb-9e63f4b56995 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:46.059246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a130de9-235f-4ab8-a0cb-9e63f4b56995 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:46.059246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a130de9-235f-4ab8-a0cb-9e63f4b56995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:46.060426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a130de9-235f-4ab8-a0cb-9e63f4b56995 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:46.066752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 477/954] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:46.072239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:46.128204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:46.179904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd4ef9-07f8-4107-8c6b-641301f57f4a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:46.215534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c99098-bbbd-4a59-a336-e625928bd8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:46.216205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99098-bbbd-4a59-a336-e625928bd8ad None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:46.216485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99098-bbbd-4a59-a336-e625928bd8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:46.216781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99098-bbbd-4a59-a336-e625928bd8ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:46.217537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c99098-bbbd-4a59-a336-e625928bd8ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:46.218927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c99098-bbbd-4a59-a336-e625928bd8ad None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:46.241480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 478/955] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:19:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:46.635750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cdac8-696d-4f20-b91a-b6970390e636 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:46.636153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cdac8-696d-4f20-b91a-b6970390e636 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:46.636335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cdac8-696d-4f20-b91a-b6970390e636 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:46.638006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 478/956] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:46.643249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe6ffe-1ddb-43e0-b609-9ea3d5137984 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:46.643539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe6ffe-1ddb-43e0-b609-9ea3d5137984 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:46.643940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe6ffe-1ddb-43e0-b609-9ea3d5137984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:46.661835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-18fe6ffe-1ddb-43e0-b609-9ea3d5137984 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:46.663064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-18fe6ffe-1ddb-43e0-b609-9ea3d5137984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:46.743943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 479/957] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:46.767462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cdac8-696d-4f20-b91a-b6970390e636 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:46.773133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:46.873952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cdac8-696d-4f20-b91a-b6970390e636 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:46.908867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:46.910043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:46.910516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:46.910967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:46.911821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:46.913416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:46.925922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:46.927033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:46.927912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:46.930418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 479/958] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:46.936825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe6ffe-1ddb-43e0-b609-9ea3d5137984 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:46.974184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:47.046751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe6ffe-1ddb-43e0-b609-9ea3d5137984 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:47.083363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce380be-67cd-40ee-8fcd-e12567b27df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:47.084097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce380be-67cd-40ee-8fcd-e12567b27df7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:47.084357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce380be-67cd-40ee-8fcd-e12567b27df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:47.084593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce380be-67cd-40ee-8fcd-e12567b27df7 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:47.085353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce380be-67cd-40ee-8fcd-e12567b27df7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:47.085662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce380be-67cd-40ee-8fcd-e12567b27df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:47.087041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce380be-67cd-40ee-8fcd-e12567b27df7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:47.092249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 480/959] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:47.097858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:47.164304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:47.197309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379500a-4bf5-4d18-96c1-18e1aff06f6f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:47.229516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f4b30-8f4b-45d8-82e6-cfa707fe7b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:47.230248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f4b30-8f4b-45d8-82e6-cfa707fe7b6d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:47.230537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f4b30-8f4b-45d8-82e6-cfa707fe7b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:47.230813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f4b30-8f4b-45d8-82e6-cfa707fe7b6d None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:47.231571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f4b30-8f4b-45d8-82e6-cfa707fe7b6d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:47.231884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f4b30-8f4b-45d8-82e6-cfa707fe7b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:47.233300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f4b30-8f4b-45d8-82e6-cfa707fe7b6d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:47.238130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 480/960] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:47.955375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a06d8-6a11-4c04-9723-c2d32931de79 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:47.955770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a06d8-6a11-4c04-9723-c2d32931de79 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:47.955948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a06d8-6a11-4c04-9723-c2d32931de79 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:47.957632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 481/961] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:47.962907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1800b01-5830-46e4-924d-008aa472c0a7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:47.963202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1800b01-5830-46e4-924d-008aa472c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:47.963486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1800b01-5830-46e4-924d-008aa472c0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:47.980844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b1800b01-5830-46e4-924d-008aa472c0a7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:47.982057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b1800b01-5830-46e4-924d-008aa472c0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:48.009514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f9651-e469-46b4-ac5f-06a8c83d08c0 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.010123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f9651-e469-46b4-ac5f-06a8c83d08c0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.010590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f9651-e469-46b4-ac5f-06a8c83d08c0 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.012423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 482/962] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:48.017594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17f2f0-10cc-414f-90d7-48ac733fae00 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.018124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17f2f0-10cc-414f-90d7-48ac733fae00 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.018700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17f2f0-10cc-414f-90d7-48ac733fae00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.050241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eb17f2f0-10cc-414f-90d7-48ac733fae00 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:48.054434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 481/963] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:48.059398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eb17f2f0-10cc-414f-90d7-48ac733fae00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:48.078225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1800b01-5830-46e4-924d-008aa472c0a7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.148748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:48.155044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 483/964] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:48.185798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17f2f0-10cc-414f-90d7-48ac733fae00 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.186728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1800b01-5830-46e4-924d-008aa472c0a7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:48.220775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:48.237235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:48.238834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.239587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.240013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.241191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:48.243561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:48.262192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.sql.core [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 11:19:48.262192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 11:19:48.262192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [parameters: {'user_id': '35f68974ce2742e2a752fbad87f0f3c2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 11:19:48.262192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jun 23 11:19:48.273285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:19:48.274418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application yield resource Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise self.value Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application session.commit() Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 11:19:48.275661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.flush() Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application compat.raise_( Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 11:19:48.276914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 11:19:48.278012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 11:19:48.278896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [parameters: {'user_id': '35f68974ce2742e2a752fbad87f0f3c2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:48.279713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 11:19:48.280507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 11:19:48.288028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 11:19:48.288028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 11:19:48.288028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 11:19:48.288028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 11:19:48.288028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 11:19:48.288028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.288028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 482/965] 10.222.0.66 () {60 vars in 1131 bytes} [Thu Jun 23 11:19:48 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:48.289380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.313126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17f2f0-10cc-414f-90d7-48ac733fae00 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:48.351753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:48.353131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.353626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.354172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.367090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:48.376619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:48.377665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:48.378761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:48.381962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 484/966] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:48.390431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.415163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb371ad-16e0-4238-8392-4f2fa9b0622b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:48.441826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:48.455762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3160d-a4b3-42a5-92f7-b04221240637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:48.456656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3160d-a4b3-42a5-92f7-b04221240637 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.456971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3160d-a4b3-42a5-92f7-b04221240637 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.457242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3160d-a4b3-42a5-92f7-b04221240637 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.466013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3160d-a4b3-42a5-92f7-b04221240637 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:48.467665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3160d-a4b3-42a5-92f7-b04221240637 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-45d3160d-a4b3-42a5-92f7-b04221240637 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:48.483057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:48.484229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 11:19:48.485367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.489049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 483/967] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:48.491374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2530525-f9fb-4d29-ad90-98f8a0d17a4f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.491804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2530525-f9fb-4d29-ad90-98f8a0d17a4f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.492090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2530525-f9fb-4d29-ad90-98f8a0d17a4f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.496424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 484/968] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:48.497098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2530525-f9fb-4d29-ad90-98f8a0d17a4f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.501732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:48.515549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c3103-5ef7-4493-9d1c-f8f2168b70c0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:48.557601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894b9e5-1ba2-4bc9-b59b-859505af4774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:48.559135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894b9e5-1ba2-4bc9-b59b-859505af4774 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.559895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894b9e5-1ba2-4bc9-b59b-859505af4774 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.560368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894b9e5-1ba2-4bc9-b59b-859505af4774 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.561991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894b9e5-1ba2-4bc9-b59b-859505af4774 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:48.562973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894b9e5-1ba2-4bc9-b59b-859505af4774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:48.564892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894b9e5-1ba2-4bc9-b59b-859505af4774 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:48.574236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 485/969] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:48.575598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb51333-1705-412a-acbb-0ecfdb8da281 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.575887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb51333-1705-412a-acbb-0ecfdb8da281 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.576163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb51333-1705-412a-acbb-0ecfdb8da281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.594687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3eb51333-1705-412a-acbb-0ecfdb8da281 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:48.595881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3eb51333-1705-412a-acbb-0ecfdb8da281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:48.615494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2530525-f9fb-4d29-ad90-98f8a0d17a4f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:48.653926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:48.654863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.655144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.655420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.656672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:48.657027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:48.658872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:48.672853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 486/970] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:48.672853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb51333-1705-412a-acbb-0ecfdb8da281 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.709558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 485/971] 10.222.0.66 () {56 vars in 1101 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:48.710663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.762352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:48.790382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb51333-1705-412a-acbb-0ecfdb8da281 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:48.792304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:48.835141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:48.835957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.836237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.836553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.849588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:48.851078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:48.870851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:48.871809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:48.872691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:48.872691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:48.872691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:48.872691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:48.877070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 487/972] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:48.878553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:48.886820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816c72-a63f-4ab4-a553-94600947fa4c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:48.934968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:48.936105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:48.936556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:48.937046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:48.938227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:48.939824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:48.954267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:48.955570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:48.956948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:48.957983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 486/973] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:48.964871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.005643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aef68-7687-434d-8221-57d3140be01d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.038685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.043366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.043366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.043660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.045082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.045082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:49.045082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.046571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.062020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 488/974] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:49.068197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.078016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d577a-8eee-45a7-a418-858099c6ba94 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.086504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.115756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.116734 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.117021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.117296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.118170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:49.118819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.120476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.129066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 487/975] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:49.132535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.173795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8339c-ad5c-4d77-9869-888ad87f53c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.212261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.213228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.213508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.213886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.221673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.223890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.235053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027a6d-a006-4afd-b545-4ab40b24cea2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:49.240327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:49.241587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 11:19:49.242527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:49.245068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 489/976] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:49.247065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.275368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.276167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.276380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.277052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.277683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:49.277996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.279410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.285832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 488/977] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:49.292033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.304740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.330134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.353028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d36023-ac71-4a14-a78e-3e5d93bce712 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.386334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578b550-ee2b-45f5-89ef-512d039eb6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.387005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b550-ee2b-45f5-89ef-512d039eb6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.387280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b550-ee2b-45f5-89ef-512d039eb6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.387551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578b550-ee2b-45f5-89ef-512d039eb6b8 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.388378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b550-ee2b-45f5-89ef-512d039eb6b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:49.388683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b550-ee2b-45f5-89ef-512d039eb6b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.390125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578b550-ee2b-45f5-89ef-512d039eb6b8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.397915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd069e-7c43-4145-8bd5-7c7f1ba57f42 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.406842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 490/978] 10.222.0.66 () {56 vars in 1149 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:49.408106 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c8891-d72f-4377-bce5-a01464ab1482 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.408447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c8891-d72f-4377-bce5-a01464ab1482 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.408909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c8891-d72f-4377-bce5-a01464ab1482 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.409999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 491/979] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:49.412996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c8891-d72f-4377-bce5-a01464ab1482 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.433777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1bf61-52a8-4e85-b76e-8e3a338a1dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.434457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1bf61-52a8-4e85-b76e-8e3a338a1dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.434737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1bf61-52a8-4e85-b76e-8e3a338a1dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.435009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1bf61-52a8-4e85-b76e-8e3a338a1dd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.435813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1bf61-52a8-4e85-b76e-8e3a338a1dd7 None admin] RBAC: Adding query filter params (interface=admin, service_id=bba5d4e1d32f4eacbdb4a460797b5cc2, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:49.436111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1bf61-52a8-4e85-b76e-8e3a338a1dd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.437878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b1bf61-52a8-4e85-b76e-8e3a338a1dd7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.448205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 489/980] 10.222.0.66 () {56 vars in 1249 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/endpoints?service_id=bba5d4e1d32f4eacbdb4a460797b5cc2&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:49.448205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab98e1-3a17-4450-b807-5e678efb030a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.448205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab98e1-3a17-4450-b807-5e678efb030a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.448205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab98e1-3a17-4450-b807-5e678efb030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.461969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d3ab98e1-3a17-4450-b807-5e678efb030a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:49.463489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3ab98e1-3a17-4450-b807-5e678efb030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:49.524733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c8891-d72f-4377-bce5-a01464ab1482 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.530062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 490/981] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:49.530892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab98e1-3a17-4450-b807-5e678efb030a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.549112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.557972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.574279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.574942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.575226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.575501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.632551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab98e1-3a17-4450-b807-5e678efb030a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.642709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.644372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.666374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.667054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.667335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.667613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.668301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.669716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.675787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 491/982] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:19:49.676535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.755585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 492/983] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:19:49.761726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:49.775371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.794427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:49.808608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90dd8b-22be-4afc-a1a4-1fc392a8ea7b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.851630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.852186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.852464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.852760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.853496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.854884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.872769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 492/984] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:49 2022] POST /identity/v3/services => generated 242 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:49.883997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f84ae-41ee-4b76-8828-3df0074ea5e8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:49.932886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:49.933717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:49.933997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:49.934225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:49.946885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:49.948326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:49.968479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:49.969713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:49.970632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:49.970632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:49.970632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:49.970632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:49.970632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 493/985] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:49.976839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:50.088310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9f1fe-ffb0-4afe-bb2c-5f398459607c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:50.123641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:50.124324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:50.124607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:50.124864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:50.125629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:50.125937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:50.127306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:50.140827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 493/986] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:50.146235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:50.212496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:50.269608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cd730-77fa-45a5-81a3-aeac4ce3b8c2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:50.306555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:50.307368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:50.307653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:50.307922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:50.315207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:50.317408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:50.331135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:50.332061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:50.332988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:50.333456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 494/987] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:50.338812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:50.354469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:50.447273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1f632-f3a0-4ab0-bfb0-95e6250fa950 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:50.482675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b5258-f5ad-40e5-b776-26bfce0d5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:50.483340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b5258-f5ad-40e5-b776-26bfce0d5b40 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:50.483616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b5258-f5ad-40e5-b776-26bfce0d5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:50.483882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b5258-f5ad-40e5-b776-26bfce0d5b40 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:50.484668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b5258-f5ad-40e5-b776-26bfce0d5b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:50.485000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b5258-f5ad-40e5-b776-26bfce0d5b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:50.486419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b5258-f5ad-40e5-b776-26bfce0d5b40 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:50.498632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 494/988] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:50.504629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:50.613163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc39f-5c77-41fa-a8bd-806df6031e4b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:50.630911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:50.649514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7729a43-50ee-4bf9-b224-86fcaa344ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:50.650198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7729a43-50ee-4bf9-b224-86fcaa344ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:50.650480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7729a43-50ee-4bf9-b224-86fcaa344ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:50.650755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7729a43-50ee-4bf9-b224-86fcaa344ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:50.651587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7729a43-50ee-4bf9-b224-86fcaa344ad7 None admin] RBAC: Adding query filter params (role.id=52ea0a3c3a88492189b9638b329341fd, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=f47acd9b12ef428c941175dd18ca3029) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:50.651899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7729a43-50ee-4bf9-b224-86fcaa344ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:50.653395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7729a43-50ee-4bf9-b224-86fcaa344ad7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:50.659818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 495/989] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:19:50 2022] GET /identity/v3/role_assignments?user.id=f47acd9b12ef428c941175dd18ca3029&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=52ea0a3c3a88492189b9638b329341fd => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:51.781826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d25f-42a1-4c00-82fc-cf46e9451cdd None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:51.782471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d25f-42a1-4c00-82fc-cf46e9451cdd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:51.782471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7d25f-42a1-4c00-82fc-cf46e9451cdd None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:51.783797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 495/990] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:51.790738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee6a78-cf9e-4d3d-9f50-02f4b1f83cbb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:51.791318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee6a78-cf9e-4d3d-9f50-02f4b1f83cbb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:51.791318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee6a78-cf9e-4d3d-9f50-02f4b1f83cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:51.810466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0aee6a78-cf9e-4d3d-9f50-02f4b1f83cbb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:51.811627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0aee6a78-cf9e-4d3d-9f50-02f4b1f83cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:51.884857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 496/991] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:51.908119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7d25f-42a1-4c00-82fc-cf46e9451cdd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:51.936118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6393ca-9f48-489d-817b-0be6d8864c05 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:51.936856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6393ca-9f48-489d-817b-0be6d8864c05 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:51.937474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6393ca-9f48-489d-817b-0be6d8864c05 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:51.938996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 497/992] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:51.944205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f01de-cc34-47ad-bdd9-35713ad32937 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:51.944482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f01de-cc34-47ad-bdd9-35713ad32937 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:51.944812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f01de-cc34-47ad-bdd9-35713ad32937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:51.962541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d76f01de-cc34-47ad-bdd9-35713ad32937 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:51.963929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d76f01de-cc34-47ad-bdd9-35713ad32937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:51.990570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:52.023794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7d25f-42a1-4c00-82fc-cf46e9451cdd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.035983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 498/993] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:52.059052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f01de-cc34-47ad-bdd9-35713ad32937 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.071772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.072784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.073075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.073353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.074020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.075413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:52.088174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:52.089281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:52.090165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 496/994] 10.222.0.66 () {56 vars in 1126 bytes} [Thu Jun 23 11:19:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:52.095244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.109262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:52.173923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f01de-cc34-47ad-bdd9-35713ad32937 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.211197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f8ff-8ff7-42a2-9124-ce0b78889d01 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.213909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.214939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.215397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.215855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.216688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.218486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:52.231432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:52.232436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:52.233495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:52.236028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 499/995] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:52.241900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.245241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.245919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.246202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.247191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.247191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:52.247477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.248992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.250885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:52.259180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 497/996] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:52.259892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.370449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d805a64-1191-4a7e-bd1b-479882cbd028 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.374574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc0cdd-3d11-44fe-ad27-a5d4e745cdb7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.380496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:52.413080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.413760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.414040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.414316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.415033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:52.415339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.416126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.416729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.416905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.417166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.417443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.418556 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:52.419224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.420892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.426921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 500/997] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:52.427728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.429070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 498/998] 10.222.0.66 () {56 vars in 1122 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:52.432508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.501499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:52.552683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff64011-961e-4c58-a4ef-b40b6249c42f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.554447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ef988-857f-4358-a9c7-b29f8b52a9b5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.593640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da117f-094d-488c-aa12-807b13008118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.594351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da117f-094d-488c-aa12-807b13008118 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.594632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da117f-094d-488c-aa12-807b13008118 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.594906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da117f-094d-488c-aa12-807b13008118 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.595621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da117f-094d-488c-aa12-807b13008118 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:52.595930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da117f-094d-488c-aa12-807b13008118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.596865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88052c47-73e3-48c6-87b9-b2cdbe1b5534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.597414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da117f-094d-488c-aa12-807b13008118 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.597636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052c47-73e3-48c6-87b9-b2cdbe1b5534 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.597996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052c47-73e3-48c6-87b9-b2cdbe1b5534 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.598336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88052c47-73e3-48c6-87b9-b2cdbe1b5534 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.599390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88052c47-73e3-48c6-87b9-b2cdbe1b5534 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.601190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88052c47-73e3-48c6-87b9-b2cdbe1b5534 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.606850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 499/999] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:52.611898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da117f-094d-488c-aa12-807b13008118 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.623840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 501/1000] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:19:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:52.721412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13914a-ce4d-44b4-ba23-1a5ffe9c4271 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.722278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13914a-ce4d-44b4-ba23-1a5ffe9c4271 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.722278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13914a-ce4d-44b4-ba23-1a5ffe9c4271 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.723849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 502/1001] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:52.729606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91386-e539-49d7-a044-a4207ab86424 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.730065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91386-e539-49d7-a044-a4207ab86424 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.730357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd91386-e539-49d7-a044-a4207ab86424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.738361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da117f-094d-488c-aa12-807b13008118 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.748460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5fd91386-e539-49d7-a044-a4207ab86424 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:52.749895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5fd91386-e539-49d7-a044-a4207ab86424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:52.771852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:52.780471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:52.794333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.795082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.795439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.795963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.797775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] RBAC: Adding query filter params (interface=public, service_id=e49328196aa041d0bb40a5b595f83f91, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:52.798126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.799797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.805496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 500/1002] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/endpoints?service_id=e49328196aa041d0bb40a5b595f83f91&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:52.811646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.835063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 503/1003] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:52.858618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd91386-e539-49d7-a044-a4207ab86424 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:52.917308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c5d83-4a74-4931-a539-3b6706fa71b3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.952462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:52.953712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:52.954315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:52.954790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:52.955674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:52.957755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:52.960793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd91386-e539-49d7-a044-a4207ab86424 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:52.965511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 501/1004] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:19:53.004965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:53.005840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:53.006123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:53.006438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:53.007213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:53.008623 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:53.021762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:53.022885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:53.029205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 504/1005] 10.222.0.66 () {56 vars in 1105 bytes} [Thu Jun 23 11:19:52 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:53.030040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:53.099395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:53.154416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f3795-992d-404e-ae6f-276c563c42dc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:53.191380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1638d64-8c08-4b5c-b970-3757717838d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:53.192066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638d64-8c08-4b5c-b970-3757717838d2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:53.192347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638d64-8c08-4b5c-b970-3757717838d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:53.192626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1638d64-8c08-4b5c-b970-3757717838d2 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:53.193368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1638d64-8c08-4b5c-b970-3757717838d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:53.193677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1638d64-8c08-4b5c-b970-3757717838d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:53.195054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1638d64-8c08-4b5c-b970-3757717838d2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:53.204767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 502/1006] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:53.206524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:53.233615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:53.320303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0657f-9387-4483-9847-c9fb268885c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:53.355618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83033db-3ebd-437e-a207-14eb8faa84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:53.356293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83033db-3ebd-437e-a207-14eb8faa84f8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:53.356575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83033db-3ebd-437e-a207-14eb8faa84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:53.356880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83033db-3ebd-437e-a207-14eb8faa84f8 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:53.357596 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83033db-3ebd-437e-a207-14eb8faa84f8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:53.357901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83033db-3ebd-437e-a207-14eb8faa84f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:53.359277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83033db-3ebd-437e-a207-14eb8faa84f8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:53.364235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 505/1007] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:54.694008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dfa13-ad74-4c43-b685-f244cb13d1e5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:54.694586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dfa13-ad74-4c43-b685-f244cb13d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:54.694586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dfa13-ad74-4c43-b685-f244cb13d1e5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:54.696115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 503/1008] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:54.701211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51004b-99d3-4b98-aa0d-0d23251a45b7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:54.701612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51004b-99d3-4b98-aa0d-0d23251a45b7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:54.701793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51004b-99d3-4b98-aa0d-0d23251a45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:54.718622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ce51004b-99d3-4b98-aa0d-0d23251a45b7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:54.719823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ce51004b-99d3-4b98-aa0d-0d23251a45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:54.792883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 506/1009] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:54.812768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dfa13-ad74-4c43-b685-f244cb13d1e5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:54.917357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dfa13-ad74-4c43-b685-f244cb13d1e5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:54.933736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:54.953200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a73a9-86a6-4234-b227-1d246b62fd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:54.954304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a73a9-86a6-4234-b227-1d246b62fd77 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:54.954767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a73a9-86a6-4234-b227-1d246b62fd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:54.955215 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a73a9-86a6-4234-b227-1d246b62fd77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:54.956634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a73a9-86a6-4234-b227-1d246b62fd77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:54.958306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a73a9-86a6-4234-b227-1d246b62fd77 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:54.960454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 504/1010] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:54.965952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51004b-99d3-4b98-aa0d-0d23251a45b7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:54.985783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:55.001606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53aa9-33b1-48ff-bab5-295f460b0a12 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.001874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53aa9-33b1-48ff-bab5-295f460b0a12 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.002150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53aa9-33b1-48ff-bab5-295f460b0a12 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.003808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 505/1011] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:55.008573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392d99-9ace-490a-8f54-913ab1969547 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.008892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392d99-9ace-490a-8f54-913ab1969547 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.009174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392d99-9ace-490a-8f54-913ab1969547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.030006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9f392d99-9ace-490a-8f54-913ab1969547 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:55.031364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9f392d99-9ace-490a-8f54-913ab1969547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:55.084410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51004b-99d3-4b98-aa0d-0d23251a45b7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:55.105294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 506/1012] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:19:55.123182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:55.123854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.124135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.124408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.125159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:55.126587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:55.128120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f392d99-9ace-490a-8f54-913ab1969547 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:55.155164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 507/1013] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:54 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:55.250851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f392d99-9ace-490a-8f54-913ab1969547 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:55.266322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:55.289617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990838c-f1ee-45fe-b1cf-1532ec821596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:55.290442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990838c-f1ee-45fe-b1cf-1532ec821596 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.290723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990838c-f1ee-45fe-b1cf-1532ec821596 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.290997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990838c-f1ee-45fe-b1cf-1532ec821596 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.291669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990838c-f1ee-45fe-b1cf-1532ec821596 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:55.293104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990838c-f1ee-45fe-b1cf-1532ec821596 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b990838c-f1ee-45fe-b1cf-1532ec821596 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:55.305614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:55.306699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 11:19:55.307556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:55.312815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 507/1014] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:55.313386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:55.374758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f27d-2db4-4d4e-9c0b-4178d3bdc80d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.375045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f27d-2db4-4d4e-9c0b-4178d3bdc80d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.375321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3f27d-2db4-4d4e-9c0b-4178d3bdc80d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.376690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 508/1015] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:19:55.383382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71672c2-cd1f-4140-8447-d4c097052967 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.383665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71672c2-cd1f-4140-8447-d4c097052967 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.383941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71672c2-cd1f-4140-8447-d4c097052967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.390220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:55.404314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b71672c2-cd1f-4140-8447-d4c097052967 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:55.406107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b71672c2-cd1f-4140-8447-d4c097052967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:55.425322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157528c-bb03-431a-b3e3-0c757a50b83e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:55.463156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:55.463828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.464110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.464385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.465138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:55.465445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:55.466812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:55.476446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 508/1016] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:55.477516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:55.485549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 509/1017] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:55.508795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71672c2-cd1f-4140-8447-d4c097052967 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:55.578798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc2278-9b46-40d2-845a-8f3418c661f0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:55.607546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71672c2-cd1f-4140-8447-d4c097052967 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:55.611946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:55.612615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.612966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.613243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.613944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:55.614255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:55.615630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:55.616966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:55.617619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:55.624625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 509/1018] 10.222.0.66 () {56 vars in 1112 bytes} [Thu Jun 23 11:19:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:55.630360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:55.650423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66231b-27c7-44d4-b8e5-8fba94a33c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:55.651108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66231b-27c7-44d4-b8e5-8fba94a33c7d None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.651392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66231b-27c7-44d4-b8e5-8fba94a33c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.651669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66231b-27c7-44d4-b8e5-8fba94a33c7d None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.652419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66231b-27c7-44d4-b8e5-8fba94a33c7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:55.653815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66231b-27c7-44d4-b8e5-8fba94a33c7d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:55.672501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 510/1019] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:19:55 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:55.745082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf02d2-3a24-40e9-baa9-446bc1a0c2ce None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:55.791599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03a309-7674-4f81-a64d-ee44313295be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:55.792571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a309-7674-4f81-a64d-ee44313295be None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:55.793028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a309-7674-4f81-a64d-ee44313295be None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:55.793471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03a309-7674-4f81-a64d-ee44313295be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:55.794413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03a309-7674-4f81-a64d-ee44313295be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:55.795963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03a309-7674-4f81-a64d-ee44313295be None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:55.825154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 510/1020] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:19:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:19:57.247696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7836-2ffa-4309-9be9-99ca9693a0c2 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.248237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7836-2ffa-4309-9be9-99ca9693a0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.248237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb7836-2ffa-4309-9be9-99ca9693a0c2 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.249866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 511/1021] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:57.255030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d739-0b54-4745-8c37-ecadcf801ea4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.255485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d739-0b54-4745-8c37-ecadcf801ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.255576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510d739-0b54-4745-8c37-ecadcf801ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.272592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3510d739-0b54-4745-8c37-ecadcf801ea4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:57.273923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3510d739-0b54-4745-8c37-ecadcf801ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:57.321198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:57.350994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 511/1022] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:57.375964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb7836-2ffa-4309-9be9-99ca9693a0c2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:57.479804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb7836-2ffa-4309-9be9-99ca9693a0c2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:57.513993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc054ef-9ca0-4ffc-8a87-a289ddca3da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:57.514795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc054ef-9ca0-4ffc-8a87-a289ddca3da6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.515074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc054ef-9ca0-4ffc-8a87-a289ddca3da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.515344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc054ef-9ca0-4ffc-8a87-a289ddca3da6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.516533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc054ef-9ca0-4ffc-8a87-a289ddca3da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:57.517999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc054ef-9ca0-4ffc-8a87-a289ddca3da6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:57.519869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 512/1023] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:57.525568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d739-0b54-4745-8c37-ecadcf801ea4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:57.629459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510d739-0b54-4745-8c37-ecadcf801ea4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:57.665043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4602fd-1b58-410a-8ceb-7f606f22d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:57.665720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4602fd-1b58-410a-8ceb-7f606f22d738 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.665997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4602fd-1b58-410a-8ceb-7f606f22d738 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.666270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4602fd-1b58-410a-8ceb-7f606f22d738 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.666976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4602fd-1b58-410a-8ceb-7f606f22d738 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:57.668413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4602fd-1b58-410a-8ceb-7f606f22d738 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:57.690306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 512/1024] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:19:57 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:57.726795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303c476-7897-4ae3-a972-e6836417b1c1 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.727055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303c476-7897-4ae3-a972-e6836417b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.727349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303c476-7897-4ae3-a972-e6836417b1c1 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.728986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 513/1025] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:57.734789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01417d2-3e91-4049-9975-5ba9008b42c1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.735097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01417d2-3e91-4049-9975-5ba9008b42c1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.735356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01417d2-3e91-4049-9975-5ba9008b42c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.753953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f01417d2-3e91-4049-9975-5ba9008b42c1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:57.755192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f01417d2-3e91-4049-9975-5ba9008b42c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:57.787951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:57.839222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 513/1026] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:57.862426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303c476-7897-4ae3-a972-e6836417b1c1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:57.899367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:57.948307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337eef-680d-42a2-ad23-7dd3a487be40 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.948684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337eef-680d-42a2-ad23-7dd3a487be40 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.949114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337eef-680d-42a2-ad23-7dd3a487be40 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.950555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 514/1027] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:57.955772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7dcd-1dad-40a9-8693-1a8f167954bc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:57.956063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7dcd-1dad-40a9-8693-1a8f167954bc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:57.956352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d7dcd-1dad-40a9-8693-1a8f167954bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:57.970358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303c476-7897-4ae3-a972-e6836417b1c1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:57.974349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e08d7dcd-1dad-40a9-8693-1a8f167954bc None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:57.975548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e08d7dcd-1dad-40a9-8693-1a8f167954bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:58.005717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.006628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.007039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.007317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] PATH_INFO: `/v3/services/image` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.007982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.009479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:58.022755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:58.023793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:58.024621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 514/1028] 10.222.0.66 () {56 vars in 1105 bytes} [Thu Jun 23 11:19:57 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:58.030043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.060514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 515/1029] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:19:58.077783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7dcd-1dad-40a9-8693-1a8f167954bc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.144999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:58.148235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d89f6-b80c-4d71-b6a7-4cb2ecc4123a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.179353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:58.185396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.186080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.186368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.186993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.187697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] RBAC: Adding query filter params (name=image) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:58.188012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.189423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.189751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d7dcd-1dad-40a9-8693-1a8f167954bc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.199714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 515/1030] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:58.200793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.231092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.232245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.232536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.232843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.246408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:19:58.255064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:58.261109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:58.262101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 516/1031] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:58.263837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.310749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d422ce-e8a4-47ce-8867-0de491083232 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.352105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.352815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.353095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.353372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.354079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:58.354385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.355763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.361013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 516/1032] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:58.367071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.373211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552a0fa-b12a-4c68-afde-442fe429faa2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.400427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:58.407773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.408431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.408803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.409232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.410168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:58.410480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.411869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.420310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 517/1033] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:58.425956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.444789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:58.478007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e73c76-e958-45fd-8924-29404c335db4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.513678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.514354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.514642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.514915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.515709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] RBAC: Adding query filter params (interface=public, service_id=820a994ada064450a423f5e5ea9c3b5c, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:58.516020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.517436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.523113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 517/1034] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/endpoints?service_id=820a994ada064450a423f5e5ea9c3b5c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:58.528563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.545644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6bb7d-42ca-465f-a810-c4abe7a237b8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.579961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.580794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.581094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.581373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.593985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.595671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:58.613892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:58.614861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:58.615771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:58.615771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:58.615771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:58.615771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:58.615771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 518/1035] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:19:58.620993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.626886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:58.637238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53e8eb-0862-446d-96a5-59bf1b415b6d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.676318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.677389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.677902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.678758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.679922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.681961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.691339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:58.693777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 518/1036] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:19:58.731793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90579dbc-0b65-4023-8e28-72a046893477 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.774237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.774923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.775204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.775474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.776276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:58.776586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.778053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.792037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 519/1037] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:58.797588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:58.905707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7266532-c27f-4335-99d4-a2e3e399fb19 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:58.939691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:58.940602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:58.940912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:58.941186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:58.948955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:58.950384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:19:58.964474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:58.965631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:58.967170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 519/1038] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:58.971745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:59.083037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad4dc9-2a9f-4034-bafc-b06118fac484 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:59.108672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:59.118786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:59.119688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:59.120139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:59.120629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:59.121692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:59.122147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:59.123732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:59.142599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 520/1039] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:19:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:59.147951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:59.168101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:59.252787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2ed9d-d377-4b82-b04c-03f0d2ddad90 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:59.286250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:59.286951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:59.287232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:59.287498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:59.354321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:59.355693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:59.374939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:59.468694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 520/1040] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:19:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:19:59.474361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:59.576285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab8007-1eac-4738-9da0-4fece738ba27 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:59.609893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf09ffc-f628-4210-9e17-d1cc094cf6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:59.610677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09ffc-f628-4210-9e17-d1cc094cf6bc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:59.610957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09ffc-f628-4210-9e17-d1cc094cf6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:59.611228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09ffc-f628-4210-9e17-d1cc094cf6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:59.622442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf09ffc-f628-4210-9e17-d1cc094cf6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:59.623917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf09ffc-f628-4210-9e17-d1cc094cf6bc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ecf09ffc-f628-4210-9e17-d1cc094cf6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:19:59.641476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:59.642398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:59.643447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:19:59.643447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:19:59.643447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:19:59.643447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:19:59.645209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 521/1041] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:59.648498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:59.757426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794a30-8fdf-4f5f-b851-e3ec69c4ef40 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:59.775347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:59.794162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:59.794849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:59.795131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:59.795402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:59.796161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:59.796466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:59.797939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:59.805482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250297-2d74-452a-b09c-b02595c1f5b7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:59.806505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250297-2d74-452a-b09c-b02595c1f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:59.806784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250297-2d74-452a-b09c-b02595c1f5b7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:59.808949 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 522/1042] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:19:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:19:59.811330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 521/1043] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:19:59.816060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784f7-134b-4007-a5a6-77d8379e7305 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:59.816695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784f7-134b-4007-a5a6-77d8379e7305 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:59.817018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41784f7-134b-4007-a5a6-77d8379e7305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:59.817495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:59.836421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b41784f7-134b-4007-a5a6-77d8379e7305 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:59.837660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b41784f7-134b-4007-a5a6-77d8379e7305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:59.868131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:59.912441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 523/1044] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:19:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:19:59.923624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463f46d-b32f-45a9-a11f-e055c261c343 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:59.935849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41784f7-134b-4007-a5a6-77d8379e7305 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:59.962394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:59.963597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:59.963597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:59.963767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:59.970883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:59.972502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:19:59.986687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:19:59.987721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:19:59.988605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:19:59.992822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 522/1045] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:19:59.993678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:00.031322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:00.049768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41784f7-134b-4007-a5a6-77d8379e7305 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:00.090266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:00.091074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.091361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.091649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.102361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:00.109722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5b45-44ec-4000-bcd8-f79e773d6138 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:00.110551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:00.111703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:00.112752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 524/1046] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:00.118248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:00.150293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:00.150941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.151223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.151496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.152289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:00.152599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:00.153977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:00.154086 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:00.166075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 523/1047] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:00.172004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:00.235861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6c54f-80a2-4370-97d1-176e1a276d42 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:00.278586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:00.279316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.279617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.279878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.280633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:00.280971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:00.282403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:00.282668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:00.291230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460942e8-2f30-41a7-96aa-3c65fcfd10ba None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:00.291445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 525/1048] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:00.296993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:00.334374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:00.335182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.335511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.335853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.336702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] RBAC: Adding query filter params (role.id=52ea0a3c3a88492189b9638b329341fd, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=bb2aadd5a1204d35a8325b3d56d20b03) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:00.337056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:00.338529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:00.344820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 524/1049] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:00 2022] GET /identity/v3/role_assignments?user.id=bb2aadd5a1204d35a8325b3d56d20b03&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=52ea0a3c3a88492189b9638b329341fd => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:00.405630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:00.422251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5dc92-1176-414c-b8d8-c0e0e5798105 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:00.467740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:00.468661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.468970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.469240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] PATH_INFO: `/v3/users/172f0914d3db4182a700adc30dd4e360` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.486407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] RBAC: Authorizing `identity:get_user(user_id=172f0914d3db4182a700adc30dd4e360)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:00.488096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:00.495071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 526/1050] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:00 2022] GET /identity/v3/users/172f0914d3db4182a700adc30dd4e360 => generated 285 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:00.496946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:00.612727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d949f7-a6d6-4b4d-96e6-7305a093214f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:00.649558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771425c5-13e8-4698-8b47-be017f80b94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:00.650241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771425c5-13e8-4698-8b47-be017f80b94a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.650526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771425c5-13e8-4698-8b47-be017f80b94a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.650775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771425c5-13e8-4698-8b47-be017f80b94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.681451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:00.725210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771425c5-13e8-4698-8b47-be017f80b94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:00.726678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771425c5-13e8-4698-8b47-be017f80b94a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:00.831759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 525/1051] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:00.837740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:00.840251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a4a1-fea3-40bd-b076-a11c94b117b5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.840542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a4a1-fea3-40bd-b076-a11c94b117b5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.840864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a4a1-fea3-40bd-b076-a11c94b117b5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.842274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 526/1052] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:00.847992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295109f5-e351-4c04-9db8-ce56d8bbd008 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.848270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295109f5-e351-4c04-9db8-ce56d8bbd008 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.848551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295109f5-e351-4c04-9db8-ce56d8bbd008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.865954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-295109f5-e351-4c04-9db8-ce56d8bbd008 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:00.867166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-295109f5-e351-4c04-9db8-ce56d8bbd008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:00.928206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:00.940999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 527/1053] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:00.948603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53a64-2c6d-4cd3-924a-c5231074baab None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:00.966513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295109f5-e351-4c04-9db8-ce56d8bbd008 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:00.986423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:00.987491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:00.987777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:00.988044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:00.989393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] RBAC: Authorizing `identity:get_project(project_id=5389143352f24579b44d92c7d0731d69)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:00.991288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:00.998324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 527/1054] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:00 2022] GET /identity/v3/projects/5389143352f24579b44d92c7d0731d69 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:00.999776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:01.018470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:01.085404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295109f5-e351-4c04-9db8-ce56d8bbd008 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:01.120521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfd5c4-7887-4339-817e-4b98a15a385f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:01.126146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:01.127314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:01.127912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:01.128366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] PATH_INFO: `/v3/services/image` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:01.129272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:01.130975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:01.144277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:01.145348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:01.146204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 528/1055] 10.222.0.66 () {56 vars in 1105 bytes} [Thu Jun 23 11:20:00 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:01.156835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:01.161383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:01.162066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:01.162379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:01.162642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:01.163490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=5389143352f24579b44d92c7d0731d69, user.id=172f0914d3db4182a700adc30dd4e360) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:01.163791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:01.165275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:01.171424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 528/1056] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:00 2022] GET /identity/v3/role_assignments?user.id=172f0914d3db4182a700adc30dd4e360&scope.project.id=5389143352f24579b44d92c7d0731d69&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:01.222182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:01.273506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7bbfe-7d49-4d7d-a614-5967a643d164 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:01.312436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:01.313166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:01.313442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:01.313709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:01.314456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] RBAC: Adding query filter params (name=image) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:01.314851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:01.316293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:01.322383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 529/1057] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:01.328181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:01.411744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:01.435358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec638a98-53d8-4f9a-ad69-d4a4f1a2517f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:01.469708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d04f87-78d1-453d-b3e3-018ce885d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:01.470371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d04f87-78d1-453d-b3e3-018ce885d2da None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:01.470654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d04f87-78d1-453d-b3e3-018ce885d2da None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:01.470930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d04f87-78d1-453d-b3e3-018ce885d2da None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:01.471994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d04f87-78d1-453d-b3e3-018ce885d2da None admin] RBAC: Adding query filter params (type=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:01.472445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d04f87-78d1-453d-b3e3-018ce885d2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:01.473689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d04f87-78d1-453d-b3e3-018ce885d2da None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:01.478997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 529/1058] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:01.484777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:01.590754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cee31-2902-4851-9a8a-1e7ea1fc1daf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:01.607901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:01.626870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfd9d7-e799-40f0-81e1-db70529aef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:01.626870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfd9d7-e799-40f0-81e1-db70529aef0f None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:01.626870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfd9d7-e799-40f0-81e1-db70529aef0f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:01.626870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfd9d7-e799-40f0-81e1-db70529aef0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:01.627599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfd9d7-e799-40f0-81e1-db70529aef0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:01.629260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfd9d7-e799-40f0-81e1-db70529aef0f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:01.652763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 530/1059] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:20:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:20:02.435571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7d27-5c77-4777-9f1e-93d89e9126f3 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:02.436153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7d27-5c77-4777-9f1e-93d89e9126f3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:02.436153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7d27-5c77-4777-9f1e-93d89e9126f3 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:02.438081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 530/1060] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:02.443329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687201-af7e-4f24-8924-23f844a1322e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:02.443627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687201-af7e-4f24-8924-23f844a1322e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:02.443857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687201-af7e-4f24-8924-23f844a1322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:02.461735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-22687201-af7e-4f24-8924-23f844a1322e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:02.462933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-22687201-af7e-4f24-8924-23f844a1322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:02.536982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 531/1061] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:02.559639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7d27-5c77-4777-9f1e-93d89e9126f3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:02.663817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7d27-5c77-4777-9f1e-93d89e9126f3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:02.699156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:02.699899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:02.700181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:02.700454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:02.710994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:02.719121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:02.720032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:02.721685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 531/1062] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jun 23 11:20:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:02.726581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687201-af7e-4f24-8924-23f844a1322e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:02.827864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:02.832063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22687201-af7e-4f24-8924-23f844a1322e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:02.867572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:02.868252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:02.868531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:02.868836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:02.869587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:02.869896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:02.871269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:02.880444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 532/1063] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jun 23 11:20:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:02.886117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:02.889354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:02.988812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af2673-b00e-4432-ab62-02c4167c152f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.022267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57457646-a7bd-4864-aea6-7a7f3cea3511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.023067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457646-a7bd-4864-aea6-7a7f3cea3511 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.023348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457646-a7bd-4864-aea6-7a7f3cea3511 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.023622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57457646-a7bd-4864-aea6-7a7f3cea3511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.034731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57457646-a7bd-4864-aea6-7a7f3cea3511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.036213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57457646-a7bd-4864-aea6-7a7f3cea3511 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-57457646-a7bd-4864-aea6-7a7f3cea3511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:20:03.055933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:03.056942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:03.057878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:20:03.057878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:20:03.057878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:03.057878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:03.062618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 532/1064] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:03.063799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.173490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12079a-348b-4316-b799-9f1d6aec9910 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.192952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e937-8114-4091-8f7c-b69fda125d46 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.193275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e937-8114-4091-8f7c-b69fda125d46 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.193515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e937-8114-4091-8f7c-b69fda125d46 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.195072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 533/1065] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:20:03.199809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bcbe0-12e9-467b-b389-22aaaaba588d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.200082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bcbe0-12e9-467b-b389-22aaaaba588d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.200384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bcbe0-12e9-467b-b389-22aaaaba588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.210834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.211506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.211791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.212051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.212803 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:03.213108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.214481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.218394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0d2bcbe0-12e9-467b-b389-22aaaaba588d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:03.219762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0d2bcbe0-12e9-467b-b389-22aaaaba588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:03.226802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 533/1066] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:03.232430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.259401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:03.274013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:03.297987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 534/1067] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:20:03.321493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bcbe0-12e9-467b-b389-22aaaaba588d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.348587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955128-7d8d-471a-8a6a-d540994fd9f4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.389314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.390269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.390848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.391126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.400354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.401903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:20:03.418112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:03.419135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:03.420095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 534/1068] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:03.425629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.432447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bcbe0-12e9-467b-b389-22aaaaba588d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.469891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.470898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.471177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.471454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.482740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:03.490366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:03.491292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:03.492129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 535/1069] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:03.497662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.518787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:03.539208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58bb8-f7de-42c9-9744-ecb9dd54556e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.545346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:03.576503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.577219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.577506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.577785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.578638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:03.578951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.580631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.603761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 535/1070] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:03.604895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.610936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fedb4f-d315-465a-9eb3-630a74c41f87 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.646173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.646853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.647133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.647405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.648153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:03.648460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.649870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.658712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 536/1071] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:03.664489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.724373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b080032-7b3a-4885-af71-15e56ee71d3a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.759776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bf19b-d167-474b-84bf-b099b8066236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.760584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf19b-d167-474b-84bf-b099b8066236 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.760903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf19b-d167-474b-84bf-b099b8066236 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.761182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bf19b-d167-474b-84bf-b099b8066236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.770783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:03.773376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bf19b-d167-474b-84bf-b099b8066236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.775314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bf19b-d167-474b-84bf-b099b8066236 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.775699 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86e5f0-a239-41c2-9a47-6b7ddabe1dbc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.783218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ad0bf19b-d167-474b-84bf-b099b8066236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:20:03.794109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:03.795181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:03.796259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:20:03.796259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:20:03.796259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:03.796259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:03.800168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 536/1072] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:03.801524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ff5a-759b-440c-9385-cfc10a51f531 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.801809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ff5a-759b-440c-9385-cfc10a51f531 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.802082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ff5a-759b-440c-9385-cfc10a51f531 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.803377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 537/1073] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:03.804055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ff5a-759b-440c-9385-cfc10a51f531 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.815545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a629f-3fb8-4ebf-a2a0-874736fbddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.816439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a629f-3fb8-4ebf-a2a0-874736fbddcd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.816739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a629f-3fb8-4ebf-a2a0-874736fbddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.817046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a629f-3fb8-4ebf-a2a0-874736fbddcd None admin] PATH_INFO: `/v3/users/172f0914d3db4182a700adc30dd4e360` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.818279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a629f-3fb8-4ebf-a2a0-874736fbddcd None admin] RBAC: Authorizing `identity:get_user(user_id=172f0914d3db4182a700adc30dd4e360)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.819741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a629f-3fb8-4ebf-a2a0-874736fbddcd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.821391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 537/1074] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/users/172f0914d3db4182a700adc30dd4e360 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:03.822522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46afb-faeb-456e-8969-98a2b4704bf9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.822808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46afb-faeb-456e-8969-98a2b4704bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.823084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c46afb-faeb-456e-8969-98a2b4704bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.839906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-21c46afb-faeb-456e-8969-98a2b4704bf9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:03.841131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-21c46afb-faeb-456e-8969-98a2b4704bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:03.902939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ff5a-759b-440c-9385-cfc10a51f531 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:03.909551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 538/1075] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:03.910386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c46afb-faeb-456e-8969-98a2b4704bf9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:03.936271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:03.937316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:03.937596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:03.937870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:03.938589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:03.938889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:03.940308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:03.951290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 538/1076] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:03.952067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:04.002548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:04.022412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c46afb-faeb-456e-8969-98a2b4704bf9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.024738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:04.058519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.059409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.059688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.059960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.061184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] RBAC: Authorizing `identity:get_project(project_id=5389143352f24579b44d92c7d0731d69)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.062017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78840900-d90c-42ff-b205-f5de9105cfb1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.062973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.065466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 539/1077] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/projects/5389143352f24579b44d92c7d0731d69 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:04.065642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:04.099649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.100304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.100582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.100893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.165486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7f6bf-c797-4df9-89ea-15a3d1438168 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.166951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.168414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.201549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.202352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.202633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.202911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.209844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.211290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.223836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:20:04.225384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:04.226284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:04.227393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 540/1078] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:04.228065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:04.262081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:04.274406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 539/1079] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:04.275233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:04.334349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b4b3d-891a-40a3-96b6-c65d5b5c8a83 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.372034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.373475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.373856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.374041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69/users/172f0914d3db4182a700adc30dd4e360/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.376110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] RBAC: Authorizing `identity:create_grant(project_id=5389143352f24579b44d92c7d0731d69, user_id=172f0914d3db4182a700adc30dd4e360, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.377770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.379188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0118-30d5-4ae8-a1e3-491f1de611b2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.391692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 541/1080] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:20:04 2022] PUT /identity/v3/projects/5389143352f24579b44d92c7d0731d69/users/172f0914d3db4182a700adc30dd4e360/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:20:04.392509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:04.418811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.419503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.419787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.420061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.421148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:04.421301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.422763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.441899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 540/1081] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:04.443054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:04.460237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:04.508734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:04.520824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d836-2d81-4768-9b3d-f2cab78a2c1d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.559132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbbc0b-f8ab-494a-89d2-94e84822f43a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.563428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.564326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.564672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.564963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.576877 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.578640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.598952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1cc16-ff83-491f-ad85-2f0fed7f61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:20:04.600029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:04.601015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:04.601930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:20:04.601930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:20:04.601930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:04.601930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:04.601930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 542/1082] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:04.602587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1cc16-ff83-491f-ad85-2f0fed7f61b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.603030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1cc16-ff83-491f-ad85-2f0fed7f61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.603492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1cc16-ff83-491f-ad85-2f0fed7f61b9 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/bb2aadd5a1204d35a8325b3d56d20b03/roles/52ea0a3c3a88492189b9638b329341fd` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.606036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1cc16-ff83-491f-ad85-2f0fed7f61b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=bb2aadd5a1204d35a8325b3d56d20b03, role_id=52ea0a3c3a88492189b9638b329341fd)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.607010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:04.607903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1cc16-ff83-491f-ad85-2f0fed7f61b9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.622805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 541/1083] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:20:04 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/bb2aadd5a1204d35a8325b3d56d20b03/roles/52ea0a3c3a88492189b9638b329341fd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:20:04.721932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e50f4-10bd-4ff7-ba2a-6f8a8477f1e4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:04.758948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5f04c-0865-4740-9d0e-e50ecdb8fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:04.759619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f04c-0865-4740-9d0e-e50ecdb8fc1d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:04.759899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f04c-0865-4740-9d0e-e50ecdb8fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:04.760171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5f04c-0865-4740-9d0e-e50ecdb8fc1d None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:04.760934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5f04c-0865-4740-9d0e-e50ecdb8fc1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:04.761245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5f04c-0865-4740-9d0e-e50ecdb8fc1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:04.762631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5f04c-0865-4740-9d0e-e50ecdb8fc1d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:04.777143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 543/1084] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:06.483444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d153d-69a7-461b-82e9-7483f0a1dd21 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:06.483982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d153d-69a7-461b-82e9-7483f0a1dd21 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:06.483982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d153d-69a7-461b-82e9-7483f0a1dd21 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:06.485583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 542/1085] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:06.491431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f5ed-5cc4-407a-b834-528401800809 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:06.491895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f5ed-5cc4-407a-b834-528401800809 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:06.492249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266f5ed-5cc4-407a-b834-528401800809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:06.498807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:06.511667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f266f5ed-5cc4-407a-b834-528401800809 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:06.512915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f266f5ed-5cc4-407a-b834-528401800809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:06.586818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 544/1086] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:06.610685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d153d-69a7-461b-82e9-7483f0a1dd21 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:06.637189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fab74-2089-43c8-8072-cc0e02cbefe4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:06.637476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fab74-2089-43c8-8072-cc0e02cbefe4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:06.637756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fab74-2089-43c8-8072-cc0e02cbefe4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:06.639293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 545/1087] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:06.644362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5f42-33b0-480d-8494-f4c3e649ce79 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:06.644745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5f42-33b0-480d-8494-f4c3e649ce79 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:06.645033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5f42-33b0-480d-8494-f4c3e649ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:06.661746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b48f5f42-33b0-480d-8494-f4c3e649ce79 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:06.662931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b48f5f42-33b0-480d-8494-f4c3e649ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:06.688195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:06.720000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d153d-69a7-461b-82e9-7483f0a1dd21 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:06.732423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 546/1088] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:06.753632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:06.754375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:06.754652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:06.754918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:06.756274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5f42-33b0-480d-8494-f4c3e649ce79 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:06.765445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:06.773466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:06.774443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:06.775304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:06.779788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 543/1089] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:06.780567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:06.830429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:06.874973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5f42-33b0-480d-8494-f4c3e649ce79 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:06.889600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f71445-7970-4cdb-9326-d264011dc5c1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:06.908737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:06.909543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:06.909839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:06.910109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:06.919190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:06.920350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:06.925054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:06.925718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:06.925997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:06.926267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:06.927023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:06.927322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:06.928552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:06.929638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 11:20:06.930848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:06.931676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:06.931757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 547/1090] 10.222.0.66 () {56 vars in 1120 bytes} [Thu Jun 23 11:20:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:06.935865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:06.940940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 544/1091] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:06.946598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.035897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb68f6-74be-4622-a97f-d2f5827f7e8f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.041938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d82d98-7349-4fb1-8356-15fb6b4e87ed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.066945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:07.076791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.077696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.077972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.078065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.078245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] PATH_INFO: `/v3/users/172f0914d3db4182a700adc30dd4e360` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.078666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.078950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.079223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.079445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] RBAC: Authorizing `identity:get_user(user_id=172f0914d3db4182a700adc30dd4e360)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.079959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:07.080408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.081202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.081822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.082838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 545/1092] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:06 2022] GET /identity/v3/users/172f0914d3db4182a700adc30dd4e360 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:07.088467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.090569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 548/1093] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jun 23 11:20:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:07.096205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.152803 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:07.198361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ede0bb-1c75-4b43-a657-9b7e7c4c6172 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.201798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bad17-ee21-44e1-8587-1bea4b96792b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.233133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.233950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.234226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.234496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.239441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.240097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.240377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.240651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.246157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.247620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:20:07.265371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:07.266399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:07.267461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:20:07.267461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:20:07.267461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:07.267461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:07.267461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 549/1094] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:07.272456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.313287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:07.314856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.316461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.374914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f90f6-3a97-415f-b60e-99d2d0f6c903 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.377817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:07.408866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.409546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.409830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.410105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.410831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:07.411140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.412512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.417729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 546/1095] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 11:20:07.423599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.423751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 550/1096] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:07.429465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.520386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5edf99-fe77-45c1-83ed-64a38f0c4d56 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.523294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:07.527073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69c89-89c5-4e95-b49f-3ded1354ad9d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.554326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.555210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.555493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.555761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.556969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] RBAC: Authorizing `identity:get_project(project_id=5389143352f24579b44d92c7d0731d69)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.558411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.560135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 547/1097] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/projects/5389143352f24579b44d92c7d0731d69 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:07.563531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.564267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.565723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.566571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.567975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.575818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.577297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:20:07.591669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:07.592634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:07.593597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 551/1098] 10.222.0.66 () {56 vars in 1093 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:07.598017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:07.599185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.666617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d330a-e87a-41ba-a93f-f3000db7d1bd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.700615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.701304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.701585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.701855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.702677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=5389143352f24579b44d92c7d0731d69, user.id=172f0914d3db4182a700adc30dd4e360) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:07.702782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e8d7-4d52-4339-845c-0d9426680cba None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.702983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.704429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.711063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 548/1099] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/role_assignments?user.id=172f0914d3db4182a700adc30dd4e360&scope.project.id=5389143352f24579b44d92c7d0731d69&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:07.738574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.739283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.739566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.739841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.740700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:07.741041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.742516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:07.762909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 552/1100] 10.222.0.66 () {56 vars in 1133 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:07.769912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:07.869804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:07.878502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533631fb-3ed3-4271-ad20-7cd2cb6f48d6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:07.912577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:07.913286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:07.913567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:07.913832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:07.982805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:07.984281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:08.083792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:08.091782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 549/1101] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:08.097679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:08.117121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:08.202477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07ed7d-1f96-4422-9468-c6155dc0d121 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:08.238620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:08.239417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:08.239700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:08.239971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:08.250451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:08.251961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:20:08.269773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:08.270686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:08.271761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:20:08.271761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:20:08.271761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:20:08.271761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:08.271761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 553/1102] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:08.276930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:08.379511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810d3ca-b9d4-47a3-ab0c-4ab7dc649da6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:08.414433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:08.415092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:08.415370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:08.415635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:08.416351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:08.416650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:08.418041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:08.430005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 550/1103] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:08.435741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:08.504658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:08.538391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c43e40-e23a-4d64-a916-df5e4230a722 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:08.579858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:08.580767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:08.581070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:08.581318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:08.588222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:08.589708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:20:08.602943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:08.603964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:08.605035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 554/1104] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:08.610466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:08.670309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:08.714675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3932bc-14ca-44a0-af6a-2098122c9e34 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:08.748450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0793c1-ff33-445a-bd5c-bc51643a9678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:08.749140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0793c1-ff33-445a-bd5c-bc51643a9678 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:08.749417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0793c1-ff33-445a-bd5c-bc51643a9678 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:08.749690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0793c1-ff33-445a-bd5c-bc51643a9678 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:08.750467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0793c1-ff33-445a-bd5c-bc51643a9678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:08.750772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0793c1-ff33-445a-bd5c-bc51643a9678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:08.752219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0793c1-ff33-445a-bd5c-bc51643a9678 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:08.764425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 551/1105] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:08.771015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:08.875425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d93907-4782-4100-ba07-a653c1a3da33 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:08.902390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:08.911055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b49ad9-aa43-490b-b08a-564b4f1786ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:08.911703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49ad9-aa43-490b-b08a-564b4f1786ff None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:08.911981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49ad9-aa43-490b-b08a-564b4f1786ff None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:08.912255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49ad9-aa43-490b-b08a-564b4f1786ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:08.913118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b49ad9-aa43-490b-b08a-564b4f1786ff None admin] RBAC: Adding query filter params (role.id=52ea0a3c3a88492189b9638b329341fd, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=bb2aadd5a1204d35a8325b3d56d20b03) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:08.913428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b49ad9-aa43-490b-b08a-564b4f1786ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:08.914844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b49ad9-aa43-490b-b08a-564b4f1786ff None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:08.920573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 555/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:08 2022] GET /identity/v3/role_assignments?user.id=bb2aadd5a1204d35a8325b3d56d20b03&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=52ea0a3c3a88492189b9638b329341fd => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:09.747104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af3b60-8184-431f-abe4-b2e5efd58801 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:09.747650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af3b60-8184-431f-abe4-b2e5efd58801 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:09.747650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af3b60-8184-431f-abe4-b2e5efd58801 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:09.749088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 552/1107] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:09.754565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e16e-954d-4219-b68d-a7d620cb1e2d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:09.754983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e16e-954d-4219-b68d-a7d620cb1e2d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:09.755090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e16e-954d-4219-b68d-a7d620cb1e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:09.773435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-06c8e16e-954d-4219-b68d-a7d620cb1e2d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:09.774625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-06c8e16e-954d-4219-b68d-a7d620cb1e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:09.850893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 556/1108] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:09.882876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af3b60-8184-431f-abe4-b2e5efd58801 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:09.990041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af3b60-8184-431f-abe4-b2e5efd58801 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:10.004382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:10.028209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8657dd-4a9c-4179-b8c7-ac812ffae04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:10.029041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8657dd-4a9c-4179-b8c7-ac812ffae04b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:10.029324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8657dd-4a9c-4179-b8c7-ac812ffae04b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:10.029602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8657dd-4a9c-4179-b8c7-ac812ffae04b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:10.030834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8657dd-4a9c-4179-b8c7-ac812ffae04b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:10.032282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8657dd-4a9c-4179-b8c7-ac812ffae04b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:10.033931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 553/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:10.040420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e16e-954d-4219-b68d-a7d620cb1e2d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:10.149012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e16e-954d-4219-b68d-a7d620cb1e2d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:10.175326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:10.188650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101007c-d0fd-4c11-9303-8fa7e0923e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:10.189382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101007c-d0fd-4c11-9303-8fa7e0923e88 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:10.190136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101007c-d0fd-4c11-9303-8fa7e0923e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:10.190415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101007c-d0fd-4c11-9303-8fa7e0923e88 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:10.191118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101007c-d0fd-4c11-9303-8fa7e0923e88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:10.192541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101007c-d0fd-4c11-9303-8fa7e0923e88 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:10.217327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 557/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:20:10 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:20:12.267915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab569a73-1902-4c4b-93c5-611dddf3fd5b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:12.268827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab569a73-1902-4c4b-93c5-611dddf3fd5b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:12.268827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab569a73-1902-4c4b-93c5-611dddf3fd5b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:12.271092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 554/1111] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:12.276747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fa112-4288-49bf-88d6-a0b228142c89 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:12.277163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fa112-4288-49bf-88d6-a0b228142c89 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:12.277347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fa112-4288-49bf-88d6-a0b228142c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:12.294885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b25fa112-4288-49bf-88d6-a0b228142c89 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:12.296063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b25fa112-4288-49bf-88d6-a0b228142c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:12.366216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 558/1112] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:20:12.390708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab569a73-1902-4c4b-93c5-611dddf3fd5b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:12.520444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab569a73-1902-4c4b-93c5-611dddf3fd5b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:12.556049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:12.556923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:12.557198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:12.557465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] PATH_INFO: `/v3/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:12.559057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] RBAC: Authorizing `identity:get_role(role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:12.560428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:12.562187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 555/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:12 2022] GET /identity/v3/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:12.570862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fa112-4288-49bf-88d6-a0b228142c89 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:12.675565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fa112-4288-49bf-88d6-a0b228142c89 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:12.684573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:12.715734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:12.716603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:12.716907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:12.717164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] PATH_INFO: `/v3/users/a1bdcfdf31da4f609cdddac6effce1e7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:12.731485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] RBAC: Authorizing `identity:get_user(user_id=a1bdcfdf31da4f609cdddac6effce1e7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:12.732952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:12.734586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 559/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:12 2022] GET /identity/v3/users/a1bdcfdf31da4f609cdddac6effce1e7 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:12.740787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:12.797189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:12.852658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92ba66-23af-4013-8bfe-e0ce8cfcf061 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:12.888029 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:12.888672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:12.889050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:12.889322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:12.959934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:12.961412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:13.012794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:13.077886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 556/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:13.084190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:13.213564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a8463-377e-4746-b7d9-02007711e355 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:13.250789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad5e0-c56a-438b-b519-0fa7bdca281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:13.251863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad5e0-c56a-438b-b519-0fa7bdca281e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:13.252514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad5e0-c56a-438b-b519-0fa7bdca281e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:13.252823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad5e0-c56a-438b-b519-0fa7bdca281e None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:13.254114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ad5e0-c56a-438b-b519-0fa7bdca281e None admin] RBAC: Authorizing `identity:get_project(project_id=5389143352f24579b44d92c7d0731d69)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:13.255535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ad5e0-c56a-438b-b519-0fa7bdca281e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:13.257248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 560/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:13 2022] GET /identity/v3/projects/5389143352f24579b44d92c7d0731d69 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:13.266650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:13.390810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f5437-f177-442c-b224-40b7e37d48f6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:13.426533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244ed85-790d-4e37-85b3-c8719f1b4d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:13.427182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ed85-790d-4e37-85b3-c8719f1b4d55 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:13.427462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ed85-790d-4e37-85b3-c8719f1b4d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:13.427735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244ed85-790d-4e37-85b3-c8719f1b4d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:13.428564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244ed85-790d-4e37-85b3-c8719f1b4d55 None admin] RBAC: Adding query filter params (role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=5389143352f24579b44d92c7d0731d69, user.id=a1bdcfdf31da4f609cdddac6effce1e7) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:13.428904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244ed85-790d-4e37-85b3-c8719f1b4d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:13.430350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244ed85-790d-4e37-85b3-c8719f1b4d55 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:13.436260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 557/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:13 2022] GET /identity/v3/role_assignments?user.id=a1bdcfdf31da4f609cdddac6effce1e7&scope.project.id=5389143352f24579b44d92c7d0731d69&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:15.415840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f3e62-019c-4f5a-b2b1-d1fd08712240 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:15.416670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f3e62-019c-4f5a-b2b1-d1fd08712240 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:15.416670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f3e62-019c-4f5a-b2b1-d1fd08712240 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:15.418977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 561/1118] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:15.426619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dabc5d-6e8e-4006-a4d8-479e0c299794 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:15.427079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dabc5d-6e8e-4006-a4d8-479e0c299794 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:15.427174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dabc5d-6e8e-4006-a4d8-479e0c299794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:15.445622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-79dabc5d-6e8e-4006-a4d8-479e0c299794 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:15.446809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-79dabc5d-6e8e-4006-a4d8-479e0c299794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:15.457034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:15.522249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 558/1119] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:20:15.556447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f3e62-019c-4f5a-b2b1-d1fd08712240 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:15.604018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:15.677255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f3e62-019c-4f5a-b2b1-d1fd08712240 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:15.727230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:15.728433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:15.728801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:15.729086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] PATH_INFO: `/v3/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:15.731364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] RBAC: Authorizing `identity:get_role(role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:15.733593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:15.735618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 562/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:15 2022] GET /identity/v3/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 223 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:15.742037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dabc5d-6e8e-4006-a4d8-479e0c299794 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:15.850397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dabc5d-6e8e-4006-a4d8-479e0c299794 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:15.885890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:15.886757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:15.887041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:15.887313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] PATH_INFO: `/v3/users/a1bdcfdf31da4f609cdddac6effce1e7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:15.888624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] RBAC: Authorizing `identity:get_user(user_id=a1bdcfdf31da4f609cdddac6effce1e7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:15.890071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:15.891759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 559/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:15 2022] GET /identity/v3/users/a1bdcfdf31da4f609cdddac6effce1e7 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:15.901092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:16.007871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162ea8-a040-4b55-8ecd-0ea1f6920903 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:16.009476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:16.044284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf07a96-5c41-4919-9de0-2c0d3cdcecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:16.045179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07a96-5c41-4919-9de0-2c0d3cdcecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:16.045456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07a96-5c41-4919-9de0-2c0d3cdcecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:16.045707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf07a96-5c41-4919-9de0-2c0d3cdcecd0 None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:16.046945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf07a96-5c41-4919-9de0-2c0d3cdcecd0 None admin] RBAC: Authorizing `identity:get_project(project_id=5389143352f24579b44d92c7d0731d69)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:16.048470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf07a96-5c41-4919-9de0-2c0d3cdcecd0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:16.050210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 563/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:15 2022] GET /identity/v3/projects/5389143352f24579b44d92c7d0731d69 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:16.056681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:16.072556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:16.163810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366f368-b395-49c6-876d-97d960a81259 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:16.200014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea29c2-13f2-4c89-8927-7f53c08840d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:16.201058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea29c2-13f2-4c89-8927-7f53c08840d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:16.201353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea29c2-13f2-4c89-8927-7f53c08840d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:16.201654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea29c2-13f2-4c89-8927-7f53c08840d6 None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69/users/a1bdcfdf31da4f609cdddac6effce1e7/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:16.204337 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea29c2-13f2-4c89-8927-7f53c08840d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5389143352f24579b44d92c7d0731d69, user_id=a1bdcfdf31da4f609cdddac6effce1e7, role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:16.206010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea29c2-13f2-4c89-8927-7f53c08840d6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:16.221680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 560/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:20:16 2022] PUT /identity/v3/projects/5389143352f24579b44d92c7d0731d69/users/a1bdcfdf31da4f609cdddac6effce1e7/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:20:18.200884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d53f-5399-4c49-a45b-a103b51d5c60 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:18.201432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d53f-5399-4c49-a45b-a103b51d5c60 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:18.201521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d53f-5399-4c49-a45b-a103b51d5c60 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:18.203609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 564/1124] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:18.212592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ec70-bfca-4caa-89fd-0c4066954e25 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:18.213026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ec70-bfca-4caa-89fd-0c4066954e25 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:18.213218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97ec70-bfca-4caa-89fd-0c4066954e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:18.235069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8f97ec70-bfca-4caa-89fd-0c4066954e25 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:18.236318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8f97ec70-bfca-4caa-89fd-0c4066954e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:18.305562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 561/1125] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:18.330764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d53f-5399-4c49-a45b-a103b51d5c60 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:18.445163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d53f-5399-4c49-a45b-a103b51d5c60 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:18.481035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:18.481904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:18.482177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:18.482448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] PATH_INFO: `/v3/roles/0f74fa722c75483fab73d2d4fe8ac2d2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:18.484019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] RBAC: Authorizing `identity:get_role(role_id=0f74fa722c75483fab73d2d4fe8ac2d2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:18.485408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:18.487294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 565/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:18 2022] GET /identity/v3/roles/0f74fa722c75483fab73d2d4fe8ac2d2 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:18.493322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ec70-bfca-4caa-89fd-0c4066954e25 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:18.495511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:18.606841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97ec70-bfca-4caa-89fd-0c4066954e25 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:18.646400 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:18.647273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:18.647548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:18.647818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] PATH_INFO: `/v3/users/a1bdcfdf31da4f609cdddac6effce1e7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:18.649140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] RBAC: Authorizing `identity:get_user(user_id=a1bdcfdf31da4f609cdddac6effce1e7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:18.650570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:18.652209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 562/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:18 2022] GET /identity/v3/users/a1bdcfdf31da4f609cdddac6effce1e7 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:18.659163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:18.705685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:18.768126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7bf8-dd43-48a4-8376-98330ad35504 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:18.803293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:18.803921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:18.804198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:18.804470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:18.884016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:18.885434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:18.926639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:18.989294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 566/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:18.995470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:19.071192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:19.109113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991652da-ceed-44b4-9d6a-220f2c6bafe7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:19.145122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c5870-f06e-437b-87bf-37927209011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:19.145917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5870-f06e-437b-87bf-37927209011b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:19.146191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5870-f06e-437b-87bf-37927209011b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:19.146456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c5870-f06e-437b-87bf-37927209011b None admin] PATH_INFO: `/v3/projects/5389143352f24579b44d92c7d0731d69` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:19.147670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c5870-f06e-437b-87bf-37927209011b None admin] RBAC: Authorizing `identity:get_project(project_id=5389143352f24579b44d92c7d0731d69)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:19.149128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c5870-f06e-437b-87bf-37927209011b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:19.150829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 563/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:18 2022] GET /identity/v3/projects/5389143352f24579b44d92c7d0731d69 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:19.160667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:19.278221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74609355-5db9-45da-ac4a-ddfbb976f4c9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:19.316454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724dfb2-4e31-4b88-a51b-27883a220769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:19.317158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724dfb2-4e31-4b88-a51b-27883a220769 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:19.317439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724dfb2-4e31-4b88-a51b-27883a220769 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:19.317714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724dfb2-4e31-4b88-a51b-27883a220769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:19.318541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724dfb2-4e31-4b88-a51b-27883a220769 None admin] RBAC: Adding query filter params (role.id=0f74fa722c75483fab73d2d4fe8ac2d2, scope.project.id=5389143352f24579b44d92c7d0731d69, user.id=a1bdcfdf31da4f609cdddac6effce1e7) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:19.318926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724dfb2-4e31-4b88-a51b-27883a220769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:19.320401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724dfb2-4e31-4b88-a51b-27883a220769 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:19.327011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 567/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:19 2022] GET /identity/v3/role_assignments?user.id=a1bdcfdf31da4f609cdddac6effce1e7&scope.project.id=5389143352f24579b44d92c7d0731d69&role.id=0f74fa722c75483fab73d2d4fe8ac2d2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:21.366247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937048-aa67-4e6c-84ce-2c93859e43b0 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:21.367094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937048-aa67-4e6c-84ce-2c93859e43b0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:21.367094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937048-aa67-4e6c-84ce-2c93859e43b0 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:21.368520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 564/1131] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:21.374147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39fe63-a751-46c3-b7b3-e18f1efe2598 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:21.374597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39fe63-a751-46c3-b7b3-e18f1efe2598 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:21.374685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39fe63-a751-46c3-b7b3-e18f1efe2598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:21.380490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:21.395038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8e39fe63-a751-46c3-b7b3-e18f1efe2598 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:21.396246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8e39fe63-a751-46c3-b7b3-e18f1efe2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:21.467670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 568/1132] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:20:21.498726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f937048-aa67-4e6c-84ce-2c93859e43b0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:21.610437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f937048-aa67-4e6c-84ce-2c93859e43b0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:21.648775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d40b1-2477-4ae6-b3c9-3b531e3e71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:21.649860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d40b1-2477-4ae6-b3c9-3b531e3e71e6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:21.650220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d40b1-2477-4ae6-b3c9-3b531e3e71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:21.650602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d40b1-2477-4ae6-b3c9-3b531e3e71e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:21.652115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d40b1-2477-4ae6-b3c9-3b531e3e71e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:21.653716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d40b1-2477-4ae6-b3c9-3b531e3e71e6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:21.655341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 565/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:21.662233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39fe63-a751-46c3-b7b3-e18f1efe2598 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:21.775197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39fe63-a751-46c3-b7b3-e18f1efe2598 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:21.805350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:21.811416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cbe5f-2327-409f-9dda-7b5c86c75fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:21.812116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cbe5f-2327-409f-9dda-7b5c86c75fca None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:21.812399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cbe5f-2327-409f-9dda-7b5c86c75fca None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:21.812693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cbe5f-2327-409f-9dda-7b5c86c75fca None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:21.813494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cbe5f-2327-409f-9dda-7b5c86c75fca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:21.815038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cbe5f-2327-409f-9dda-7b5c86c75fca None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:21.841573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 569/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:20:21 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:20:23.905397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fb1c-4c04-4bb2-8d17-cda2e7d8204b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:23.906189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fb1c-4c04-4bb2-8d17-cda2e7d8204b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:23.906189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7fb1c-4c04-4bb2-8d17-cda2e7d8204b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:23.908152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 566/1135] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:23.914657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe151-47dc-4346-9d45-26a4e94c5b78 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:23.915115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe151-47dc-4346-9d45-26a4e94c5b78 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:23.915208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe151-47dc-4346-9d45-26a4e94c5b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:23.942285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eeefe151-47dc-4346-9d45-26a4e94c5b78 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:23.943468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eeefe151-47dc-4346-9d45-26a4e94c5b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:24.022906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 570/1136] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:24.058366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7fb1c-4c04-4bb2-8d17-cda2e7d8204b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:24.070859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:24.185592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7fb1c-4c04-4bb2-8d17-cda2e7d8204b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:24.224141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db78296-d3c4-4035-9a0c-33f6275d46b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:24.224957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db78296-d3c4-4035-9a0c-33f6275d46b9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:24.225233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db78296-d3c4-4035-9a0c-33f6275d46b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:24.225501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db78296-d3c4-4035-9a0c-33f6275d46b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:24.226801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db78296-d3c4-4035-9a0c-33f6275d46b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:24.228228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db78296-d3c4-4035-9a0c-33f6275d46b9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:24.229870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 567/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:20:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:24.238641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe151-47dc-4346-9d45-26a4e94c5b78 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:24.350117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe151-47dc-4346-9d45-26a4e94c5b78 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:24.364531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:24.386739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0de89-51b7-4f9c-ba55-f4c73757d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:24.387404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0de89-51b7-4f9c-ba55-f4c73757d15e None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:24.387688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0de89-51b7-4f9c-ba55-f4c73757d15e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:24.387959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0de89-51b7-4f9c-ba55-f4c73757d15e None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:24.388673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0de89-51b7-4f9c-ba55-f4c73757d15e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:24.390167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0de89-51b7-4f9c-ba55-f4c73757d15e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:24.411172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 571/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:20:24 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:20:26.458647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abf8fd-a1cd-416b-b773-8b90c58586d5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:26.459522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abf8fd-a1cd-416b-b773-8b90c58586d5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:26.459522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abf8fd-a1cd-416b-b773-8b90c58586d5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:26.461704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 568/1139] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:26.470752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee373abc-1c72-4dff-aa81-9b2f669a12e7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:26.471258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee373abc-1c72-4dff-aa81-9b2f669a12e7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:26.471631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee373abc-1c72-4dff-aa81-9b2f669a12e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:26.494271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ee373abc-1c72-4dff-aa81-9b2f669a12e7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:26.495453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ee373abc-1c72-4dff-aa81-9b2f669a12e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:26.568953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 572/1140] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:26.593266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abf8fd-a1cd-416b-b773-8b90c58586d5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:26.678253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:26.705457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abf8fd-a1cd-416b-b773-8b90c58586d5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:26.740616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:26.741361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:26.741643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:26.741906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:26.752593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:26.760054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:26.761208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:26.762114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 569/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:26.769194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee373abc-1c72-4dff-aa81-9b2f669a12e7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:26.875250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:26.878685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee373abc-1c72-4dff-aa81-9b2f669a12e7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:26.914631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:26.915291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:26.915569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:26.915841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:26.916579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:26.916913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:26.918268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:26.926868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 573/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:26.933614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:27.040964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9df172-23d3-4eb4-9fab-2480cd336ebb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:27.076319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:27.077242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:27.077522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:27.077789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] PATH_INFO: `/v3/users/5914f13cfc6c4e25adf1a6a2f88a75c9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:27.079948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:27.092645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] RBAC: Authorizing `identity:get_user(user_id=5914f13cfc6c4e25adf1a6a2f88a75c9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:27.094117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:27.096003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 570/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:26 2022] GET /identity/v3/users/5914f13cfc6c4e25adf1a6a2f88a75c9 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:27.102105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:27.206591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd099-26ef-4873-a835-c49b18ae7e94 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:27.242393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:27.243022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:27.243303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:27.243570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:27.274480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:27.315510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:27.316903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:27.418045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 574/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:27.425173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:27.543219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a4354-363b-4e67-a1a5-5e681cd1a14b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:27.580002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c7a03-457f-4e9f-83c2-b4bc892d86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:27.580822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7a03-457f-4e9f-83c2-b4bc892d86f6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:27.581107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7a03-457f-4e9f-83c2-b4bc892d86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:27.581377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c7a03-457f-4e9f-83c2-b4bc892d86f6 None admin] PATH_INFO: `/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:27.582670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c7a03-457f-4e9f-83c2-b4bc892d86f6 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7a06b3a2164927bb45b5bb8aef2850)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:27.584111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c7a03-457f-4e9f-83c2-b4bc892d86f6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:27.585852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 571/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:27 2022] GET /identity/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:27.592875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:27.666616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:27.713636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839612e-643d-4765-94a7-03988de9f091 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:27.752741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e8017-d2c3-4871-9c38-5a273471a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:27.753397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8017-d2c3-4871-9c38-5a273471a12d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:27.753681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8017-d2c3-4871-9c38-5a273471a12d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:27.753952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8017-d2c3-4871-9c38-5a273471a12d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:27.754777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8017-d2c3-4871-9c38-5a273471a12d None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=8b7a06b3a2164927bb45b5bb8aef2850, user.id=5914f13cfc6c4e25adf1a6a2f88a75c9) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:27.755089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8017-d2c3-4871-9c38-5a273471a12d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:27.756525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8017-d2c3-4871-9c38-5a273471a12d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:27.762135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 575/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:27 2022] GET /identity/v3/role_assignments?user.id=5914f13cfc6c4e25adf1a6a2f88a75c9&scope.project.id=8b7a06b3a2164927bb45b5bb8aef2850&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:29.747524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f43c3a-d957-4f8f-a1f0-17addc10aa9e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:29.748112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f43c3a-d957-4f8f-a1f0-17addc10aa9e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:29.748112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f43c3a-d957-4f8f-a1f0-17addc10aa9e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:29.749490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 572/1147] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:29.755886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e055d31-20ce-4b4c-93ed-937b06e2125f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:29.756573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e055d31-20ce-4b4c-93ed-937b06e2125f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:29.756760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e055d31-20ce-4b4c-93ed-937b06e2125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:29.777631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5e055d31-20ce-4b4c-93ed-937b06e2125f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:29.778819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e055d31-20ce-4b4c-93ed-937b06e2125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:29.860857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 576/1148] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:29.883811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f43c3a-d957-4f8f-a1f0-17addc10aa9e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:29.948986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:30.000458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f43c3a-d957-4f8f-a1f0-17addc10aa9e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:30.039969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:30.040766 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:30.041138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:30.041401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:30.055283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:30.066066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:30.067159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:30.068097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 573/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:30.073875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e055d31-20ce-4b4c-93ed-937b06e2125f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:30.134344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:30.179972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e055d31-20ce-4b4c-93ed-937b06e2125f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:30.216371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:30.217069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:30.217340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:30.217613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:30.218353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:30.218657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:30.220218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:30.228533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 577/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:30.235242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:30.345683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78357256-f16e-48a5-ade1-bc4719b326bc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:30.367350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:30.383151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:30.384023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:30.384304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:30.384570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] PATH_INFO: `/v3/users/5914f13cfc6c4e25adf1a6a2f88a75c9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:30.385902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] RBAC: Authorizing `identity:get_user(user_id=5914f13cfc6c4e25adf1a6a2f88a75c9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:30.387339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:30.388998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 574/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:30 2022] GET /identity/v3/users/5914f13cfc6c4e25adf1a6a2f88a75c9 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:30.396039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:30.505125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ae55b-aa1d-4b46-ad87-3044af3d39e5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:30.522609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:30.542938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742d5f-7f0f-467e-889b-70cc99ad2a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:30.543808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742d5f-7f0f-467e-889b-70cc99ad2a3b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:30.544090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742d5f-7f0f-467e-889b-70cc99ad2a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:30.544362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742d5f-7f0f-467e-889b-70cc99ad2a3b None admin] PATH_INFO: `/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:30.545702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742d5f-7f0f-467e-889b-70cc99ad2a3b None admin] RBAC: Authorizing `identity:get_project(project_id=8b7a06b3a2164927bb45b5bb8aef2850)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:30.547143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742d5f-7f0f-467e-889b-70cc99ad2a3b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:30.548944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 578/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:30 2022] GET /identity/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:30.555113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:30.665326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3aa8b-e215-40e6-a684-8a6e90df4044 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:30.700301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413b945-1bc7-4d04-aca2-355ed3284835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:30.701234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b945-1bc7-4d04-aca2-355ed3284835 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:30.701516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b945-1bc7-4d04-aca2-355ed3284835 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:30.701782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413b945-1bc7-4d04-aca2-355ed3284835 None admin] PATH_INFO: `/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850/users/5914f13cfc6c4e25adf1a6a2f88a75c9/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:30.704064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b945-1bc7-4d04-aca2-355ed3284835 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b7a06b3a2164927bb45b5bb8aef2850, user_id=5914f13cfc6c4e25adf1a6a2f88a75c9, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:30.705544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413b945-1bc7-4d04-aca2-355ed3284835 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:30.722144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 575/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:20:30 2022] PUT /identity/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850/users/5914f13cfc6c4e25adf1a6a2f88a75c9/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:20:32.703097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e6ef-90f9-4bb4-b60c-f4fe6d9a53eb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:32.703991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e6ef-90f9-4bb4-b60c-f4fe6d9a53eb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:32.703991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e6ef-90f9-4bb4-b60c-f4fe6d9a53eb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:32.705820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 579/1154] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:32.712083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ec5c-cecb-429e-86b0-5ae35ebad674 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:32.712810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ec5c-cecb-429e-86b0-5ae35ebad674 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:32.712901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053ec5c-cecb-429e-86b0-5ae35ebad674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:32.738711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2053ec5c-cecb-429e-86b0-5ae35ebad674 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:32.739894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2053ec5c-cecb-429e-86b0-5ae35ebad674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:32.785375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:32.811336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 576/1155] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:32.835055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90e6ef-90f9-4bb4-b60c-f4fe6d9a53eb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:32.947431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90e6ef-90f9-4bb4-b60c-f4fe6d9a53eb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:32.982702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:32.983412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:32.983693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:32.983965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:32.995046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:33.002581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:33.003608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:33.004674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 580/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:33.010142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ec5c-cecb-429e-86b0-5ae35ebad674 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:33.113445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053ec5c-cecb-429e-86b0-5ae35ebad674 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:33.151264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:33.151998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:33.152290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:33.152560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:33.153367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:33.153670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:33.155059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:33.163660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 577/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:33.169888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:33.223946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:33.280328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488446e-d9f8-40a2-b494-079506820ab3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:33.317535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:33.318403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:33.318682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:33.318958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] PATH_INFO: `/v3/users/5914f13cfc6c4e25adf1a6a2f88a75c9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:33.320191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] RBAC: Authorizing `identity:get_user(user_id=5914f13cfc6c4e25adf1a6a2f88a75c9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:33.321696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:33.323356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 581/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:33 2022] GET /identity/v3/users/5914f13cfc6c4e25adf1a6a2f88a75c9 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:33.331648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:33.377218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:33.438104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924923ac-d969-4f52-8244-6f77c2cd1868 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:33.477950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:33.478593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:33.478869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:33.479138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:33.546989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:33.548660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:33.601218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:33.661978 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 578/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:33.670948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:33.779456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3840d1-ad20-41b1-9c0f-82cf51bca078 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:33.793616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:33.816482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ddb1b-da60-4749-b31b-2559424da9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:33.817314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddb1b-da60-4749-b31b-2559424da9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:33.817587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddb1b-da60-4749-b31b-2559424da9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:33.817856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ddb1b-da60-4749-b31b-2559424da9f8 None admin] PATH_INFO: `/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:33.819078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ddb1b-da60-4749-b31b-2559424da9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=8b7a06b3a2164927bb45b5bb8aef2850)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:33.820503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ddb1b-da60-4749-b31b-2559424da9f8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:33.822200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 582/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:33 2022] GET /identity/v3/projects/8b7a06b3a2164927bb45b5bb8aef2850 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:33.828496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:33.928591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047d219-99ef-4005-a0be-24a9b39a78d0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:33.963730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b722e6e-b958-42ea-8b6c-e984a4514a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:33.964369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722e6e-b958-42ea-8b6c-e984a4514a43 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:33.964645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722e6e-b958-42ea-8b6c-e984a4514a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:33.964951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b722e6e-b958-42ea-8b6c-e984a4514a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:33.965775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b722e6e-b958-42ea-8b6c-e984a4514a43 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=8b7a06b3a2164927bb45b5bb8aef2850, user.id=5914f13cfc6c4e25adf1a6a2f88a75c9) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:33.966087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b722e6e-b958-42ea-8b6c-e984a4514a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:33.967504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b722e6e-b958-42ea-8b6c-e984a4514a43 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:33.973673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 579/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:33 2022] GET /identity/v3/role_assignments?user.id=5914f13cfc6c4e25adf1a6a2f88a75c9&scope.project.id=8b7a06b3a2164927bb45b5bb8aef2850&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:36.078851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488cd20-cb9e-4369-a07b-7cdf3d5e6c3d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:36.079292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488cd20-cb9e-4369-a07b-7cdf3d5e6c3d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:36.079397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488cd20-cb9e-4369-a07b-7cdf3d5e6c3d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:36.081503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 583/1162] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:36.089199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908f3b7-1d80-40ee-a0a1-55bb34cfb44c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:36.089660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908f3b7-1d80-40ee-a0a1-55bb34cfb44c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:36.089758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908f3b7-1d80-40ee-a0a1-55bb34cfb44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:36.096145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:36.107508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c908f3b7-1d80-40ee-a0a1-55bb34cfb44c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:36.108685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c908f3b7-1d80-40ee-a0a1-55bb34cfb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:36.176313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 580/1163] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:36.199830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488cd20-cb9e-4369-a07b-7cdf3d5e6c3d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:36.318415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488cd20-cb9e-4369-a07b-7cdf3d5e6c3d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:36.353847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:36.354483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:36.354763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:36.355037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:36.403874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:36.423377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:36.424860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:36.528406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 584/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:36.535008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908f3b7-1d80-40ee-a0a1-55bb34cfb44c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:36.640001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908f3b7-1d80-40ee-a0a1-55bb34cfb44c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:36.678541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441c515-8fed-4f50-af30-8bd42238827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:36.679352 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441c515-8fed-4f50-af30-8bd42238827e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:36.679636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441c515-8fed-4f50-af30-8bd42238827e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:36.679911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441c515-8fed-4f50-af30-8bd42238827e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:36.682219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:36.688734 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441c515-8fed-4f50-af30-8bd42238827e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:36.690241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441c515-8fed-4f50-af30-8bd42238827e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a441c515-8fed-4f50-af30-8bd42238827e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:36.705290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:36.706430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:36.707498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 581/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:20:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:36.715892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:36.814109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:36.833140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391612e-abfa-49b3-8c78-284610222498 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:36.870833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d461c-4e59-4327-a009-2d50f5786550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:36.871482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d461c-4e59-4327-a009-2d50f5786550 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:36.871763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d461c-4e59-4327-a009-2d50f5786550 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:36.872036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d461c-4e59-4327-a009-2d50f5786550 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:36.872754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d461c-4e59-4327-a009-2d50f5786550 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:36.873071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d461c-4e59-4327-a009-2d50f5786550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:36.874436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d461c-4e59-4327-a009-2d50f5786550 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:36.882015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 585/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Thu Jun 23 11:20:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:38.883102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b589f-8abf-478a-b07e-050df4e22d54 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:38.883968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b589f-8abf-478a-b07e-050df4e22d54 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:38.883968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b589f-8abf-478a-b07e-050df4e22d54 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:38.886262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 582/1167] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:38.891828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacaa6f-1234-4c27-b67e-0659b52cbf70 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:38.892241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacaa6f-1234-4c27-b67e-0659b52cbf70 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:38.892349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacaa6f-1234-4c27-b67e-0659b52cbf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:38.910741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fbacaa6f-1234-4c27-b67e-0659b52cbf70 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:38.911917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fbacaa6f-1234-4c27-b67e-0659b52cbf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:38.982975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 586/1168] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:39.007143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b589f-8abf-478a-b07e-050df4e22d54 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:39.128532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b589f-8abf-478a-b07e-050df4e22d54 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:39.163188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9bff2-b63d-402e-9b77-9f4f797170e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:39.163784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9bff2-b63d-402e-9b77-9f4f797170e7 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:39.164067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9bff2-b63d-402e-9b77-9f4f797170e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:39.164342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9bff2-b63d-402e-9b77-9f4f797170e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:39.165119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9bff2-b63d-402e-9b77-9f4f797170e7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:39.166498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9bff2-b63d-402e-9b77-9f4f797170e7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:39.184965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 583/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Thu Jun 23 11:20:39 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:20:41.239860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18023ab7-9ffd-41d5-9e2d-a978eae8f65a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:41.240448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18023ab7-9ffd-41d5-9e2d-a978eae8f65a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:41.240448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18023ab7-9ffd-41d5-9e2d-a978eae8f65a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:41.241829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 587/1170] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:41.248230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bed79-55bb-4f52-bc2a-301858f8fb71 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:41.249029 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bed79-55bb-4f52-bc2a-301858f8fb71 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:41.249145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bed79-55bb-4f52-bc2a-301858f8fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:41.269069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-dd1bed79-55bb-4f52-bc2a-301858f8fb71 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:41.270271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dd1bed79-55bb-4f52-bc2a-301858f8fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:41.323502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:41.343013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 584/1171] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:41.380425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18023ab7-9ffd-41d5-9e2d-a978eae8f65a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:41.474523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:41.499817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18023ab7-9ffd-41d5-9e2d-a978eae8f65a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:41.536948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf61f9d-4ba9-46ce-93de-a97ee1571b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:41.537837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61f9d-4ba9-46ce-93de-a97ee1571b6b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:41.538112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61f9d-4ba9-46ce-93de-a97ee1571b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:41.538380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf61f9d-4ba9-46ce-93de-a97ee1571b6b None admin] PATH_INFO: `/v3/domains/6ad05d58af3b4d3a8a6a15a99bfdff81` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:41.549373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf61f9d-4ba9-46ce-93de-a97ee1571b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=6ad05d58af3b4d3a8a6a15a99bfdff81)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:41.550827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf61f9d-4ba9-46ce-93de-a97ee1571b6b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:41.552459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 588/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Thu Jun 23 11:20:41 2022] GET /identity/v3/domains/6ad05d58af3b4d3a8a6a15a99bfdff81 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:41.561827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bed79-55bb-4f52-bc2a-301858f8fb71 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:41.664537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bed79-55bb-4f52-bc2a-301858f8fb71 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:41.699648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529861f-2864-4384-93e4-cafb2c342c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:41.700300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529861f-2864-4384-93e4-cafb2c342c1e None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:41.700582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529861f-2864-4384-93e4-cafb2c342c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:41.700883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529861f-2864-4384-93e4-cafb2c342c1e None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:41.701606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529861f-2864-4384-93e4-cafb2c342c1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:41.703037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529861f-2864-4384-93e4-cafb2c342c1e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:41.734397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 585/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:20:41 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:20:43.767632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6ac7-981e-4804-adc4-19d90886011f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:43.768306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6ac7-981e-4804-adc4-19d90886011f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:43.768306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af6ac7-981e-4804-adc4-19d90886011f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:43.769589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 589/1174] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:43.778483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06245843-db6b-483f-a105-6736effc39a7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:43.779231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06245843-db6b-483f-a105-6736effc39a7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:43.779404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06245843-db6b-483f-a105-6736effc39a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:43.805034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-06245843-db6b-483f-a105-6736effc39a7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:43.806468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-06245843-db6b-483f-a105-6736effc39a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:43.837707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:43.878829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 586/1175] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:43.904758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6ac7-981e-4804-adc4-19d90886011f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:44.019358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af6ac7-981e-4804-adc4-19d90886011f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:44.054811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665463-0a7a-4ac2-b355-1339a133fbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:44.055679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665463-0a7a-4ac2-b355-1339a133fbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:44.055955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665463-0a7a-4ac2-b355-1339a133fbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:44.056226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665463-0a7a-4ac2-b355-1339a133fbe5 None admin] PATH_INFO: `/v3/domains/6ad05d58af3b4d3a8a6a15a99bfdff81` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:44.057612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2665463-0a7a-4ac2-b355-1339a133fbe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6ad05d58af3b4d3a8a6a15a99bfdff81)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:44.060255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2665463-0a7a-4ac2-b355-1339a133fbe5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:44.062960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 590/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Thu Jun 23 11:20:43 2022] GET /identity/v3/domains/6ad05d58af3b4d3a8a6a15a99bfdff81 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:44.072076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06245843-db6b-483f-a105-6736effc39a7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:44.181134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06245843-db6b-483f-a105-6736effc39a7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:44.219193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a98f2-16d2-41b0-8b8a-82033c7d227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:44.219922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a98f2-16d2-41b0-8b8a-82033c7d227e None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:44.220210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a98f2-16d2-41b0-8b8a-82033c7d227e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:44.220487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a98f2-16d2-41b0-8b8a-82033c7d227e None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:44.221239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a98f2-16d2-41b0-8b8a-82033c7d227e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:44.222683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a98f2-16d2-41b0-8b8a-82033c7d227e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:44.245366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 587/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:20:44 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:20:46.291235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4e3d-9b70-462c-8704-e3acb3a8c40b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:46.292138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4e3d-9b70-462c-8704-e3acb3a8c40b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:46.292138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc4e3d-9b70-462c-8704-e3acb3a8c40b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:46.294426 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 591/1178] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:46.301931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c392-36de-408c-b23e-c1e34e396147 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:46.302365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c392-36de-408c-b23e-c1e34e396147 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:46.302492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c392-36de-408c-b23e-c1e34e396147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:46.329687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bf29c392-36de-408c-b23e-c1e34e396147 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:46.331119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bf29c392-36de-408c-b23e-c1e34e396147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:46.347871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:46.400481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 588/1179] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:46.426925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4e3d-9b70-462c-8704-e3acb3a8c40b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:46.431233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:46.548664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc4e3d-9b70-462c-8704-e3acb3a8c40b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:46.584600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:46.585350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:46.585622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:46.585868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:46.596934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:46.604376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:46.605552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:46.606533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 592/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:46.613469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29c392-36de-408c-b23e-c1e34e396147 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:46.713933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29c392-36de-408c-b23e-c1e34e396147 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:46.749140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:46.749922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:46.750083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:46.750377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:46.751119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:46.751505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:46.752873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:46.760916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 589/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:46.768469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:46.834885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:46.876176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759286-995f-42b5-8a81-7094f4fbca1b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:46.911791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:46.912658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:46.912964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:46.913235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] PATH_INFO: `/v3/users/419fb7d99024413aaef12ac42aa60605` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:46.927104 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] RBAC: Authorizing `identity:get_user(user_id=419fb7d99024413aaef12ac42aa60605)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:46.928536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:46.930209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 593/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:46 2022] GET /identity/v3/users/419fb7d99024413aaef12ac42aa60605 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:46.937919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:46.962340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:47.062603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92cdbe-2370-4c76-a18f-15f683e70822 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:47.105279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:47.105870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:47.106218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:47.106494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:47.178638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:47.180095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:47.194656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:47.280787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 590/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:47.287894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:47.409248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672d1b-e531-4352-b48d-b1bdb4b2b9ae None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:47.435293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:47.448742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa205d-35cb-42e1-b075-1b2002dbb28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:47.449650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa205d-35cb-42e1-b075-1b2002dbb28f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:47.449925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa205d-35cb-42e1-b075-1b2002dbb28f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:47.450211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa205d-35cb-42e1-b075-1b2002dbb28f None admin] PATH_INFO: `/v3/projects/ec875768db4842048af4be259bd46b02` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:47.451574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa205d-35cb-42e1-b075-1b2002dbb28f None admin] RBAC: Authorizing `identity:get_project(project_id=ec875768db4842048af4be259bd46b02)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:47.453063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa205d-35cb-42e1-b075-1b2002dbb28f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:47.454831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 594/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:47 2022] GET /identity/v3/projects/ec875768db4842048af4be259bd46b02 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:47.462003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:47.572894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc15fb-17cc-4132-afc8-c406e7af627b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:47.588109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:47.610992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4934d-16af-4356-a162-95f4bdb6c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:47.611655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4934d-16af-4356-a162-95f4bdb6c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:47.611929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4934d-16af-4356-a162-95f4bdb6c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:47.612201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4934d-16af-4356-a162-95f4bdb6c4c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:47.613064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4934d-16af-4356-a162-95f4bdb6c4c7 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=ec875768db4842048af4be259bd46b02, user.id=419fb7d99024413aaef12ac42aa60605) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:47.613376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4934d-16af-4356-a162-95f4bdb6c4c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:47.614807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4934d-16af-4356-a162-95f4bdb6c4c7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:47.620465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 591/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:47 2022] GET /identity/v3/role_assignments?user.id=419fb7d99024413aaef12ac42aa60605&scope.project.id=ec875768db4842048af4be259bd46b02&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:20:49.611680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c4784-e193-4927-bb77-9a52f509c745 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:49.612275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c4784-e193-4927-bb77-9a52f509c745 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:49.612275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c4784-e193-4927-bb77-9a52f509c745 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:49.613687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 595/1186] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:49.620014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa17345-9626-41ce-ad36-2ed6a8ed2261 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:49.620787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa17345-9626-41ce-ad36-2ed6a8ed2261 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:49.620972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa17345-9626-41ce-ad36-2ed6a8ed2261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:49.641134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cfa17345-9626-41ce-ad36-2ed6a8ed2261 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:49.642297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cfa17345-9626-41ce-ad36-2ed6a8ed2261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:49.715696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 592/1187] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:49.739920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c4784-e193-4927-bb77-9a52f509c745 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:49.860218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c4784-e193-4927-bb77-9a52f509c745 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:49.899006 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:49.899719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:49.899997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:49.900271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:49.911872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:49.919341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:49.920391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:49.921383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:20:49.924868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 596/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:20:49.927119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa17345-9626-41ce-ad36-2ed6a8ed2261 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:50.030697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa17345-9626-41ce-ad36-2ed6a8ed2261 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:50.041023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:50.080519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:50.081237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:50.081521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:50.081801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:50.082551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:50.082859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:50.084238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:50.092743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 593/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:50.099137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:50.148991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:50.202483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4d8bb-35a8-4933-b35f-3e82c0ed4f58 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:50.236415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:50.237314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:50.237587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:50.237855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] PATH_INFO: `/v3/users/419fb7d99024413aaef12ac42aa60605` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:50.239053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] RBAC: Authorizing `identity:get_user(user_id=419fb7d99024413aaef12ac42aa60605)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:50.240483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:50.242138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 597/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:50 2022] GET /identity/v3/users/419fb7d99024413aaef12ac42aa60605 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:50.248418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:50.362596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa272f9-d0fd-4476-a579-2e59c1920204 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:50.398649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e54197-c4df-4342-8e57-c9a7194e1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:50.399512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54197-c4df-4342-8e57-c9a7194e1ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:50.399793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54197-c4df-4342-8e57-c9a7194e1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:50.400062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54197-c4df-4342-8e57-c9a7194e1ea0 None admin] PATH_INFO: `/v3/projects/ec875768db4842048af4be259bd46b02` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:50.401382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e54197-c4df-4342-8e57-c9a7194e1ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=ec875768db4842048af4be259bd46b02)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:50.402820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e54197-c4df-4342-8e57-c9a7194e1ea0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:50.404509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 594/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:50 2022] GET /identity/v3/projects/ec875768db4842048af4be259bd46b02 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:50.410684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:50.521533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3bd21-f8ea-44e9-9b31-811896b7712e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:50.541845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:50.563136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7bcec-58f8-49de-876b-e13c69622363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:50.564026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7bcec-58f8-49de-876b-e13c69622363 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:50.564300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7bcec-58f8-49de-876b-e13c69622363 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:50.564604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7bcec-58f8-49de-876b-e13c69622363 None admin] PATH_INFO: `/v3/projects/ec875768db4842048af4be259bd46b02/users/419fb7d99024413aaef12ac42aa60605/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:50.567160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7bcec-58f8-49de-876b-e13c69622363 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec875768db4842048af4be259bd46b02, user_id=419fb7d99024413aaef12ac42aa60605, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:50.568587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7bcec-58f8-49de-876b-e13c69622363 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:50.584618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 598/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:20:50 2022] PUT /identity/v3/projects/ec875768db4842048af4be259bd46b02/users/419fb7d99024413aaef12ac42aa60605/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:20:52.561311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840158e-f0f1-4486-a42e-be371b83eb2d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:52.561894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840158e-f0f1-4486-a42e-be371b83eb2d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:52.561894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840158e-f0f1-4486-a42e-be371b83eb2d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:52.563289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 595/1193] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:20:52.568744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687454-7226-4315-9c5e-968e1c204c24 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:52.569179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687454-7226-4315-9c5e-968e1c204c24 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:52.569270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97687454-7226-4315-9c5e-968e1c204c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:52.595280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-97687454-7226-4315-9c5e-968e1c204c24 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:20:52.596517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-97687454-7226-4315-9c5e-968e1c204c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:52.674403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 599/1194] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:20:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:20:52.698802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840158e-f0f1-4486-a42e-be371b83eb2d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:52.741855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:52.809206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840158e-f0f1-4486-a42e-be371b83eb2d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:52.842481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:52.843254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:52.844034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:52.844314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:52.855045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:20:52.863127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:20:52.864233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:20:52.868684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 596/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:20:52.870652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97687454-7226-4315-9c5e-968e1c204c24 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:52.993046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97687454-7226-4315-9c5e-968e1c204c24 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:53.003630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:53.034973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:53.035655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:53.035941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:53.036207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:53.036982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:53.037293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:53.038683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:53.047160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 600/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:53.056979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:53.170329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:53.174505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a9cdd-1d63-4b9b-be9d-dd7736d8787c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:53.210681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:53.211549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:53.211819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:53.212087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] PATH_INFO: `/v3/users/419fb7d99024413aaef12ac42aa60605` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:53.213293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] RBAC: Authorizing `identity:get_user(user_id=419fb7d99024413aaef12ac42aa60605)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:53.214731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:53.216335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 597/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Thu Jun 23 11:20:53 2022] GET /identity/v3/users/419fb7d99024413aaef12ac42aa60605 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:53.223042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:53.341807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c7cc7-2005-493b-8c96-ae04b6c54fe7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:53.379288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:53.379932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:53.380204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:53.380468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:53.420275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:53.453423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:53.454893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:53.559389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 601/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:20:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:20:53.565837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:53.679757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd56c7-717d-4034-a063-66be04034b34 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:53.716121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37860bb1-d530-476f-b9e6-62bb96195a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:53.716961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37860bb1-d530-476f-b9e6-62bb96195a09 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:53.717238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37860bb1-d530-476f-b9e6-62bb96195a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:53.717518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37860bb1-d530-476f-b9e6-62bb96195a09 None admin] PATH_INFO: `/v3/projects/ec875768db4842048af4be259bd46b02` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:53.718815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37860bb1-d530-476f-b9e6-62bb96195a09 None admin] RBAC: Authorizing `identity:get_project(project_id=ec875768db4842048af4be259bd46b02)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:53.720261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37860bb1-d530-476f-b9e6-62bb96195a09 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:53.722016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 598/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Thu Jun 23 11:20:53 2022] GET /identity/v3/projects/ec875768db4842048af4be259bd46b02 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:20:53.728471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:53.801444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:53.835897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e84e3-e651-4a14-a471-0e9b14087f47 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:53.870311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152f32c-e3f2-47c1-9080-3f1b62291542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:53.870964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f32c-e3f2-47c1-9080-3f1b62291542 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:53.871243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f32c-e3f2-47c1-9080-3f1b62291542 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:53.871519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f32c-e3f2-47c1-9080-3f1b62291542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:53.872351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152f32c-e3f2-47c1-9080-3f1b62291542 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=ec875768db4842048af4be259bd46b02, user.id=419fb7d99024413aaef12ac42aa60605) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:20:53.872667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152f32c-e3f2-47c1-9080-3f1b62291542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:53.874133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152f32c-e3f2-47c1-9080-3f1b62291542 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:53.880234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 602/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:20:53 2022] GET /identity/v3/role_assignments?user.id=419fb7d99024413aaef12ac42aa60605&scope.project.id=ec875768db4842048af4be259bd46b02&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:03.710708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=83 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:03.877654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=33 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:49.756893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7028c-c25c-4346-bd9a-c6e182df4807 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:49.757501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7028c-c25c-4346-bd9a-c6e182df4807 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:49.757501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7028c-c25c-4346-bd9a-c6e182df4807 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:49.759149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 599/1201] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:21:49.764562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897b35-2d59-4430-92ed-577c869e62d9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:49.765022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897b35-2d59-4430-92ed-577c869e62d9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:49.765328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35897b35-2d59-4430-92ed-577c869e62d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:49.789061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-35897b35-2d59-4430-92ed-577c869e62d9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:21:49.790314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-35897b35-2d59-4430-92ed-577c869e62d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:21:49.868085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 603/1202] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:21:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:21:49.893378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7028c-c25c-4346-bd9a-c6e182df4807 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:50.022385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7028c-c25c-4346-bd9a-c6e182df4807 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:50.073552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:50.074523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:50.074804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:50.075081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:50.087708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:50.089390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:21:50.114208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:50.115262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:50.116244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:21:50.116244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:21:50.116244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:50.116244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:21:50.118674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 600/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:50.125077 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897b35-2d59-4430-92ed-577c869e62d9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:50.262914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35897b35-2d59-4430-92ed-577c869e62d9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:50.304500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:50.313586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5c833-1170-444b-8fa4-e4bf48dc9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:50.314617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c833-1170-444b-8fa4-e4bf48dc9760 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:50.315066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c833-1170-444b-8fa4-e4bf48dc9760 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:50.315350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5c833-1170-444b-8fa4-e4bf48dc9760 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:50.316088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c833-1170-444b-8fa4-e4bf48dc9760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:50.316397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c833-1170-444b-8fa4-e4bf48dc9760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:50.317823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5c833-1170-444b-8fa4-e4bf48dc9760 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:50.335204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 604/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:50.337005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:50.407135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:50.472893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9593d-49d6-479d-ac37-c6402ba6030a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:50.512682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198d44-03fc-451d-8ff9-9b2f6f3cbd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:50.513470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198d44-03fc-451d-8ff9-9b2f6f3cbd5c None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:50.513730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198d44-03fc-451d-8ff9-9b2f6f3cbd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:50.514061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198d44-03fc-451d-8ff9-9b2f6f3cbd5c None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:50.515393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198d44-03fc-451d-8ff9-9b2f6f3cbd5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:50.516898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8198d44-03fc-451d-8ff9-9b2f6f3cbd5c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:50.539787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 601/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Thu Jun 23 11:21:50 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:21:52.816666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d337-77d6-47b2-8c33-a7ecf411b51d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:52.817270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d337-77d6-47b2-8c33-a7ecf411b51d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:52.817270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d337-77d6-47b2-8c33-a7ecf411b51d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:52.818785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 605/1206] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:21:52.825380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2dea1-7052-49d2-9b59-d7efb0d1362b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:52.825815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2dea1-7052-49d2-9b59-d7efb0d1362b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:52.826001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2dea1-7052-49d2-9b59-d7efb0d1362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:52.843963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b4a2dea1-7052-49d2-9b59-d7efb0d1362b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:21:52.845208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b4a2dea1-7052-49d2-9b59-d7efb0d1362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:21:52.927811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 602/1207] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:21:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:21:52.952367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92d337-77d6-47b2-8c33-a7ecf411b51d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:53.098375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92d337-77d6-47b2-8c33-a7ecf411b51d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:53.140954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:53.142151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:53.142495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:53.142850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:53.158328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:21:53.166889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:53.167902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:53.168944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 606/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:53.175246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2dea1-7052-49d2-9b59-d7efb0d1362b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:53.226444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:53.309032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2dea1-7052-49d2-9b59-d7efb0d1362b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:53.350392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:53.351084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:53.351571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:53.351918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:53.352825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:53.353134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:53.354523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:53.364783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 603/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:21:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:53.369585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:53.429356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:53.491276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e442c-bcc0-4ba7-ac1d-fc111d2047a7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:53.533703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:53.534517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:53.534832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:53.535102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:53.553475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:53.554979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:21:53.573584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:53.574743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:53.575637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:21:53.575637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:21:53.575637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:53.575637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:53.575637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 607/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:21:53.581169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:53.696167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:53.700429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585822b-3add-4180-92e7-92032ca33f19 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:53.744517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:53.745252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:53.745665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:53.745849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:53.746588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:53.746879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:53.748357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:53.761990 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 604/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:53.769277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:53.894026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d73cd7-f02d-4a8b-92b6-df09ec8440dd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:53.895786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:53.935399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:53.936425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:53.936708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:53.937007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:53.945198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:53.946846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:21:53.962479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:53.963678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:53.964639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 608/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:21:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:53.969864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:54.103524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cb3df-9261-4c76-987b-3bf98d5a01fa None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:54.143764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:54.144539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:54.144909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:54.145252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:54.146093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:54.146403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:54.147831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:54.180762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 605/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jun 23 11:21:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:54.180964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:54.308079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be22da-f2c9-41b5-9085-116a9fbbd3b7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:54.345883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:54.346686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:54.347065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:54.347508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:54.385316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:54.429347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:54.431349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:54.558546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 609/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:21:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 11:21:54.564861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:54.586142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:54.682287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa31c-cf57-48f9-b6d4-d17ddd04c505 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:54.723322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:54.724177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:54.724461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:54.725104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:54.736589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:54.738105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:21:54.758768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:54.759882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:54.765682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:21:54.765682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:21:54.765682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:54.765682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:21:54.765682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 606/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:54.766186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:54.836167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:54.881456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ba27-e699-4067-b5ad-e3f97cda141b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:54.918477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:54.919168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:54.919434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:54.919713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:54.920530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:54.920920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:54.922266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:54.935255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 610/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:21:54.941662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:55.024211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:55.065724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7d238-b036-4a7c-83d5-70551efbfa14 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:55.102030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:55.102821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:55.103090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:55.103411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:55.110745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:55.112295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:21:55.127037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:55.128258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:21:55.129414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 607/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:21:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:55.134521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:55.255780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008f670-3080-4dce-b580-0ac3de11e126 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:55.283967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:55.297411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7335a-6694-4d0a-b7a1-08a3cf48b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:55.298408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7335a-6694-4d0a-b7a1-08a3cf48b396 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:55.298714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7335a-6694-4d0a-b7a1-08a3cf48b396 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:55.298985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7335a-6694-4d0a-b7a1-08a3cf48b396 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:55.299806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7335a-6694-4d0a-b7a1-08a3cf48b396 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:55.300097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7335a-6694-4d0a-b7a1-08a3cf48b396 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:55.301590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7335a-6694-4d0a-b7a1-08a3cf48b396 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:55.319621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 611/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:55.320868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:55.424223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea19ce8-7142-4996-9957-6d42038ce167 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:55.457106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:55.464489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56701c81-944d-4ac8-9249-d9596f8f1cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:55.465213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701c81-944d-4ac8-9249-d9596f8f1cda None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:55.465533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701c81-944d-4ac8-9249-d9596f8f1cda None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:55.465877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56701c81-944d-4ac8-9249-d9596f8f1cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:55.466891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56701c81-944d-4ac8-9249-d9596f8f1cda None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=5411be02252b4749be7e1a06d7ddcb45) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:55.467285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56701c81-944d-4ac8-9249-d9596f8f1cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:55.468862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56701c81-944d-4ac8-9249-d9596f8f1cda None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:55.475140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 608/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:21:55 2022] GET /identity/v3/role_assignments?user.id=5411be02252b4749be7e1a06d7ddcb45&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:57.650212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d9c2e-3c3e-4fe8-aaa3-69ed2dee8bf8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:57.651021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d9c2e-3c3e-4fe8-aaa3-69ed2dee8bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:57.651021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d9c2e-3c3e-4fe8-aaa3-69ed2dee8bf8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:57.652195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 612/1220] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:21:57.658392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db6d4-0630-4f5b-9528-a4c6e2153234 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:57.658863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db6d4-0630-4f5b-9528-a4c6e2153234 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:57.659016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72db6d4-0630-4f5b-9528-a4c6e2153234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:57.681001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c72db6d4-0630-4f5b-9528-a4c6e2153234 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:21:57.682685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c72db6d4-0630-4f5b-9528-a4c6e2153234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:21:57.760508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 609/1221] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:21:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:21:57.784993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d9c2e-3c3e-4fe8-aaa3-69ed2dee8bf8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:57.907192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d9c2e-3c3e-4fe8-aaa3-69ed2dee8bf8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:57.943205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:57.944022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:57.944325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:57.944623 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:57.957025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:21:57.965650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:57.966928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:57.967905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 613/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:21:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:57.973846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db6d4-0630-4f5b-9528-a4c6e2153234 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:58.085354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72db6d4-0630-4f5b-9528-a4c6e2153234 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:58.112935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:58.124046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:58.124745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:58.125044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:58.125322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:58.126081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:58.126390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:58.127856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:58.142260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 610/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:21:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:21:58.143565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:58.194703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:58.255635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956b54-16c0-4db6-9676-275b4900ce84 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:58.290745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:58.291540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:58.291821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:58.292111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:58.302122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:58.303593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:21:58.323488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:58.324873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:58.325893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:21:58.325893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:21:58.325893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:58.325893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:58.331796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 614/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:58.331919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:58.444267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68354f6f-5c1d-476c-bdbb-53b418878da7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:58.480628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:58.481261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:58.481538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:58.481808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:58.482594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:58.482899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:58.484401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:58.497170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 611/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:58.503565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:58.609114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:58.615958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf4446-f5a0-4bee-acda-91bb7bf15381 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:58.652262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:58.653069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:58.653367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:58.653638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:58.660980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:58.662408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:21:58.678136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:58.679347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:21:58.681220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:58.684606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 615/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:21:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:21:58.685846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:58.735792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:58.795622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f1ca-1341-4c2f-9074-2e0c1ac3d539 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:58.841315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:58.842035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:58.842317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:58.842593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:58.843441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:58.843751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:58.845253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:58.863827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 612/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jun 23 11:21:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:58.869811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:58.973816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8316-4491-4da8-b6b1-9ea85722f575 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:59.013257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:59.014056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:59.014387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:59.014692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:59.026882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:59.028614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:21:59.049582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:59.050711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:59.051827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:21:59.051827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:21:59.051827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:21:59.051827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:59.053488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 616/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:21:59.059994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:59.168645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b58d4-c6d2-4526-b23b-4ef18e9fbb9e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:59.171360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:59.204750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:59.205440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:59.205727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:59.205997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:59.206732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:59.207044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:59.208457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:59.221226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 613/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:59.227174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:59.236506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:59.333490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbfb6a-db7d-4d84-9269-10a08908d91e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:59.370152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:59.370951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:59.371232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:59.371506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:59.378952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:59.380400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:21:59.395126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:21:59.396349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:21:59.397470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 617/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:21:59.403323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:59.512600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d01629-2044-4f4f-bafc-d027aaee5948 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:59.547925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31180075-28b7-425e-b94e-31450fdd8c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:59.548660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180075-28b7-425e-b94e-31450fdd8c7d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:59.548968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180075-28b7-425e-b94e-31450fdd8c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:59.549243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180075-28b7-425e-b94e-31450fdd8c7d None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:59.550117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31180075-28b7-425e-b94e-31450fdd8c7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:21:59.550427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31180075-28b7-425e-b94e-31450fdd8c7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:59.551940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31180075-28b7-425e-b94e-31450fdd8c7d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:59.566078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 614/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:21:59.572145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:21:59.640732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:21:59.676603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2954-94f7-435f-b4a6-8b03fc6b520a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:21:59.720327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91529eea-bed4-41f0-8b10-b4bb4d4e3842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:21:59.721268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529eea-bed4-41f0-8b10-b4bb4d4e3842 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:21:59.721551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529eea-bed4-41f0-8b10-b4bb4d4e3842 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:21:59.721825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91529eea-bed4-41f0-8b10-b4bb4d4e3842 None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/5411be02252b4749be7e1a06d7ddcb45/roles/05a89bc0931e46538d695e23d585c162` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:21:59.738005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91529eea-bed4-41f0-8b10-b4bb4d4e3842 None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=5411be02252b4749be7e1a06d7ddcb45, role_id=05a89bc0931e46538d695e23d585c162)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:21:59.739463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91529eea-bed4-41f0-8b10-b4bb4d4e3842 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:21:59.752015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 618/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:21:59 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/5411be02252b4749be7e1a06d7ddcb45/roles/05a89bc0931e46538d695e23d585c162 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:22:01.828681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67afb0-06e0-4515-89dc-0ab95c0e630a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:01.829255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67afb0-06e0-4515-89dc-0ab95c0e630a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:01.829365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67afb0-06e0-4515-89dc-0ab95c0e630a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:01.831409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 615/1233] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:01.839951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280c22c-0854-4d34-9ab8-41359659da70 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:01.839951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280c22c-0854-4d34-9ab8-41359659da70 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:01.839951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280c22c-0854-4d34-9ab8-41359659da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:01.857945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0280c22c-0854-4d34-9ab8-41359659da70 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:01.859774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0280c22c-0854-4d34-9ab8-41359659da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:01.936027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 619/1234] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:22:01.960540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67afb0-06e0-4515-89dc-0ab95c0e630a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:01.989429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:02.087877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67afb0-06e0-4515-89dc-0ab95c0e630a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:02.127818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:02.128643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:02.128958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:02.129229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:02.139801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:22:02.147598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:02.148802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:02.149869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 616/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Thu Jun 23 11:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:02.154976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280c22c-0854-4d34-9ab8-41359659da70 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:02.203861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:02.262147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280c22c-0854-4d34-9ab8-41359659da70 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:02.299188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:02.299872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:02.300152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:02.300422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:02.301210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:02.301512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:02.302877 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:02.313243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 620/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Thu Jun 23 11:22:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:22:02.319796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:02.414787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:02.434727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb108209-a298-4dac-a994-05ec6ce5410f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:02.471498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:02.472325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:02.472602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:02.472912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:02.484347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:02.485863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:02.504977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:02.506111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:02.512244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:02.512244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:02.512244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:02.512244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:02.512244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 617/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:02.512580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:02.639396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb6dc6-276e-41a9-b86c-7d06ee924497 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:02.650151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:02.679646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:02.680744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:02.681182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:02.681461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:02.682308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:02.682670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:02.684373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:02.697706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 621/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:02.704226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:02.817629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4dc38-132a-4831-8a3b-bbcc210bbaf0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:02.858552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:02.859563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:02.859855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:02.860134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:02.863362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:02.869604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:02.871656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:22:02.887689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:02.889502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:02.890864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 618/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:02.895843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:03.007812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89535-6d8f-4caa-a667-42aabb5ba30c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:03.047679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:03.048622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:03.048979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:03.049358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:03.050335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:03.050759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:03.052759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:03.076437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 622/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jun 23 11:22:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:03.082525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:03.196596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70744c-a7a4-49f8-aa3c-aac20cf0258c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:03.234473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61636d02-4d31-411b-a688-714cda551530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:03.235207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61636d02-4d31-411b-a688-714cda551530 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:03.235480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61636d02-4d31-411b-a688-714cda551530 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:03.235791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61636d02-4d31-411b-a688-714cda551530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:03.301403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:03.309176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61636d02-4d31-411b-a688-714cda551530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:03.310815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61636d02-4d31-411b-a688-714cda551530 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:03.419518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 619/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:22:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:22:03.426532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:03.456984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:03.545223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a05b-34c6-4ee5-9c43-f1099a26785a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:03.583743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:03.584429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:03.584707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:03.585004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:03.595962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:03.597443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:03.614911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:03.616098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:03.617035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:03.617035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:03.617035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:03.617035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:03.617035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 623/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:03.624650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61636d02-4d31-411b-a688-714cda551530 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:03.723098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:03.729378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61636d02-4d31-411b-a688-714cda551530 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:03.768924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:03.769666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:03.769996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:03.770321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:03.771152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:03.771516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:03.773044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:03.786911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 620/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:03.793125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:03.894067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:03.917358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c03487-88c3-4292-bf20-f02a84cd15c5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:03.957701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:03.958601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:03.958914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:03.959188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:03.966786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:03.968336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:22:03.983580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:03.984630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:03.985749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 624/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:03.991262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:04.111575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a6fe8-d317-46ff-b2d8-d298068cc09d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:04.151078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa46dc-58cf-4e6d-8a09-c40258408376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:04.151659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa46dc-58cf-4e6d-8a09-c40258408376 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:04.151933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa46dc-58cf-4e6d-8a09-c40258408376 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:04.152231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa46dc-58cf-4e6d-8a09-c40258408376 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:04.153111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa46dc-58cf-4e6d-8a09-c40258408376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:04.153453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa46dc-58cf-4e6d-8a09-c40258408376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:04.155009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa46dc-58cf-4e6d-8a09-c40258408376 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:04.169225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 621/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:22:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:04.175662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:04.287947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d58a3-31c0-4c1e-90ec-ab5e2e0fa752 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:04.326214 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62683418-50c6-4eac-920f-b4985998dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:04.327013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683418-50c6-4eac-920f-b4985998dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:04.327467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683418-50c6-4eac-920f-b4985998dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:04.327770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62683418-50c6-4eac-920f-b4985998dcb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:04.329135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62683418-50c6-4eac-920f-b4985998dcb4 None admin] RBAC: Adding query filter params (role.id=05a89bc0931e46538d695e23d585c162, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=5411be02252b4749be7e1a06d7ddcb45) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:04.329501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62683418-50c6-4eac-920f-b4985998dcb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:04.331543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62683418-50c6-4eac-920f-b4985998dcb4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:04.339951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 625/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:22:04 2022] GET /identity/v3/role_assignments?user.id=5411be02252b4749be7e1a06d7ddcb45&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=05a89bc0931e46538d695e23d585c162 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:06.507545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b59cc-ca6c-40b2-91dd-52c6a8e4168a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:06.508464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b59cc-ca6c-40b2-91dd-52c6a8e4168a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:06.508464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b59cc-ca6c-40b2-91dd-52c6a8e4168a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:06.510177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 622/1247] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:06.516296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256d8e-d39f-496f-9ec0-acb8b84f153b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:06.516800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256d8e-d39f-496f-9ec0-acb8b84f153b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:06.516892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47256d8e-d39f-496f-9ec0-acb8b84f153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:06.522536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:06.538494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-47256d8e-d39f-496f-9ec0-acb8b84f153b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:06.539730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-47256d8e-d39f-496f-9ec0-acb8b84f153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:06.617760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 626/1248] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:22:06.644593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b59cc-ca6c-40b2-91dd-52c6a8e4168a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:06.666114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:06.760433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b59cc-ca6c-40b2-91dd-52c6a8e4168a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:06.800527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:06.801439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:06.801754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:06.802071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:06.815600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:22:06.824768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:06.826131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:06.827059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 623/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:22:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:06.833199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256d8e-d39f-496f-9ec0-acb8b84f153b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:06.954438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47256d8e-d39f-496f-9ec0-acb8b84f153b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:06.989557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:06.996008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:06.996894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:06.997193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:06.997588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:06.998539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:06.998850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:07.000581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:07.011590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 627/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:07.017583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:07.110687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:07.138095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a287f-5c0d-4ab8-8e62-50bf31b27c98 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:07.178022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:07.179040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:07.179361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:07.180108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:07.192262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:07.193785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:07.218000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:07.219236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:07.220274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:07.220274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:07.220274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:07.220274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:07.220274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 624/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:07.226212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:07.337904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dad457-20fa-48ae-8671-2eabb39562f1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:07.375957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:07.376693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:07.377060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:07.377398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:07.378199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:07.378667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:07.380155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:07.397459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 628/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:22:07.403455 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:07.521602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909f6b1-0049-4f73-87d7-8d77df8f28b5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:07.550372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:07.559687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:07.561111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:07.561397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:07.561674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:07.569708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:07.571171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:22:07.586154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:07.587428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:07.588677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:07.594059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:07.594564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 625/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:07.657544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:07.707392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158a73-0925-4d29-be0d-b1ab3290e1c4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:07.743695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:07.744449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:07.744801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:07.745150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:07.746038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:07.746400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:07.748114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:07.767592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 629/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jun 23 11:22:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:07.773333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:07.896954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dafecc-1c9c-4faa-8a09-bdf465746b1a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:07.935959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:07.936695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:07.937040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:07.937346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:07.998120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:08.011294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:08.012910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:08.131918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 626/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:22:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:22:08.133651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:08.246356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a2100-95f4-4443-ae8a-24cde1594c6f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:08.262044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:08.284367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:08.285233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:08.285486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:08.285805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:08.296773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:08.298557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:08.318007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:08.319301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:08.320290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:08.320290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:08.320290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:08.320290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:08.320290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 630/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:08.325864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:08.421591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:08.442587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07397158-f818-4e43-80ca-b1430841ab98 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:08.484857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:08.485539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:08.485825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:08.486102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:08.486851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:08.487158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:08.488604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:08.500832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 627/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:08.506813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:08.617406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d570ce-61cc-4ceb-ad01-e30438cc84bb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:08.658466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:08.659394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:08.659738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:08.660096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:08.667844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:08.669593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:22:08.686869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:08.687792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:08.688711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 631/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:22:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:08.694844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:08.806859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0408-5ac5-48c9-952a-8b8a2a4dbca6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:08.847736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc12e0f-4979-4013-b0c0-225ca6d55d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:08.848426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12e0f-4979-4013-b0c0-225ca6d55d67 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:08.848750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12e0f-4979-4013-b0c0-225ca6d55d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:08.849067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12e0f-4979-4013-b0c0-225ca6d55d67 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:08.850074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc12e0f-4979-4013-b0c0-225ca6d55d67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:08.850528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc12e0f-4979-4013-b0c0-225ca6d55d67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:08.852427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc12e0f-4979-4013-b0c0-225ca6d55d67 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:08.865689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 628/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:22:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:08.871820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:08.903102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:08.988023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c802a0-020c-4f1c-bfe1-e6e3334db9fe None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:09.028034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb04283-0699-4d7a-88f1-13fc6529750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:09.028819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb04283-0699-4d7a-88f1-13fc6529750b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:09.029103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb04283-0699-4d7a-88f1-13fc6529750b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:09.029378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb04283-0699-4d7a-88f1-13fc6529750b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:09.030212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb04283-0699-4d7a-88f1-13fc6529750b None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=5411be02252b4749be7e1a06d7ddcb45) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:09.030526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb04283-0699-4d7a-88f1-13fc6529750b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:09.031962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb04283-0699-4d7a-88f1-13fc6529750b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:09.037616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 632/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:22:08 2022] GET /identity/v3/role_assignments?user.id=5411be02252b4749be7e1a06d7ddcb45&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=2072cf36ca344da697b097313f411f3b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:11.139368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6cbd-20ea-4fb9-9257-d88bd351ceca None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:11.140219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6cbd-20ea-4fb9-9257-d88bd351ceca None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:11.140219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6cbd-20ea-4fb9-9257-d88bd351ceca None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:11.142544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 629/1261] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:11.149005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e344-6f5d-4160-a8df-919c89ee9b2e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:11.149457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e344-6f5d-4160-a8df-919c89ee9b2e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:11.149559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e344-6f5d-4160-a8df-919c89ee9b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:11.168615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-24a9e344-6f5d-4160-a8df-919c89ee9b2e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:11.169884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-24a9e344-6f5d-4160-a8df-919c89ee9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:11.250521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 633/1262] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:22:11.274253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6cbd-20ea-4fb9-9257-d88bd351ceca None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:11.287804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:11.392876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6cbd-20ea-4fb9-9257-d88bd351ceca None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:11.428128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e02772-970a-4aec-a994-07733133193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:11.428983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e02772-970a-4aec-a994-07733133193c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:11.429288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e02772-970a-4aec-a994-07733133193c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:11.429932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e02772-970a-4aec-a994-07733133193c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:11.441303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e02772-970a-4aec-a994-07733133193c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-96e02772-970a-4aec-a994-07733133193c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:22:11.448759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:11.449708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:11.450678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 630/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:22:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:11.456803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9e344-6f5d-4160-a8df-919c89ee9b2e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:11.476324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:11.568962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9e344-6f5d-4160-a8df-919c89ee9b2e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:11.605896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:11.606559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:11.607311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:11.607587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:11.608322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:11.608655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:11.610046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:11.618810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 634/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:22:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:11.625368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e02772-970a-4aec-a994-07733133193c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:11.695752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:11.733675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e02772-970a-4aec-a994-07733133193c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:11.776155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:11.777396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:11.777727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:11.778110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:11.796676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:11.798197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:11.816484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:11.817701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:11.818738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:11.818738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:11.818738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:11.818738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:11.818738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 631/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:11.824503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:11.915396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:11.937753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cc97d-1ae6-4236-929b-a2d390b53ce3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:11.975592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:11.976175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:11.976457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:11.976752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:11.977478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:11.977783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:11.979154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:11.992147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 635/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:22:12.000196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:12.120466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cc1bb-a1ee-4d5a-b1b5-7bb7ed9e1096 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:12.143038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:12.162550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:12.163383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:12.163668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:12.163944 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:12.171818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:12.173302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:22:12.187905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:12.189046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:12.190816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 632/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 11:22:12.198491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:12.307103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18e1b0-31fc-4fb6-bb37-4a461669c6de None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:12.342912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:12.343567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:12.343847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:12.344117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:12.344967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:12.345269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:12.346689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:12.359234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:12.369641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 636/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jun 23 11:22:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:12.377627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:12.492811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554052b-8394-4254-9ab5-8ee6ba0445e3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:12.527322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:12.528161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:12.528481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:12.528940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:12.540878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:12.542356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:12.560818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:12.561723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:12.562837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:12.562837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:12.562837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:12.562837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:12.562837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 633/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:12.571356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:12.697789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773123e-ee20-47c3-a450-d98b6c6d41ac None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:12.734903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:12.735557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:12.735837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:12.737465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:12.737465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:12.737465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:12.738530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:12.750272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 637/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:12.762587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:12.803226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:12.877722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e934d8e-a6fc-4977-8823-dc29da1732fc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:12.912430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:12.913288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:12.913567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:12.913838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:12.921022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:12.922482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:22:12.937504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:12.938507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:12.939544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:12.941064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 634/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:12.945189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:13.011255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:13.057168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac54848-761b-4bad-a7b8-f23a2690bc42 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:13.104630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4695-5557-4d5e-8c29-56913d18b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:13.105328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4695-5557-4d5e-8c29-56913d18b258 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:13.105607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4695-5557-4d5e-8c29-56913d18b258 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:13.105876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4695-5557-4d5e-8c29-56913d18b258 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:13.106898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4695-5557-4d5e-8c29-56913d18b258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:13.107212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4695-5557-4d5e-8c29-56913d18b258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:13.108676 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f4695-5557-4d5e-8c29-56913d18b258 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:13.121247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 638/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:13.128142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:13.232869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:13.242447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7282fa5-0f49-4e1c-8632-9e7cad53a1fd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:13.278891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86b679-7de5-4423-801c-ff0215316f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:13.280844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b679-7de5-4423-801c-ff0215316f3c None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:13.281218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b679-7de5-4423-801c-ff0215316f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:13.281579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86b679-7de5-4423-801c-ff0215316f3c None admin] PATH_INFO: `/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/5411be02252b4749be7e1a06d7ddcb45/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:13.285144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b679-7de5-4423-801c-ff0215316f3c None admin] RBAC: Authorizing `identity:create_grant(project_id=92c1ca6fca9e44c999e68ff7917b11b7, user_id=5411be02252b4749be7e1a06d7ddcb45, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:13.287360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86b679-7de5-4423-801c-ff0215316f3c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:13.306903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 635/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Thu Jun 23 11:22:13 2022] PUT /identity/v3/projects/92c1ca6fca9e44c999e68ff7917b11b7/users/5411be02252b4749be7e1a06d7ddcb45/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:22:15.292559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316979bf-a59c-4312-81e8-dfef59c3a6de None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:15.293165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316979bf-a59c-4312-81e8-dfef59c3a6de None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:15.293165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316979bf-a59c-4312-81e8-dfef59c3a6de None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:15.294564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 639/1274] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:15.301120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e32f5d-bd97-4d0c-8a95-1c8143d40d4d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:15.301551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e32f5d-bd97-4d0c-8a95-1c8143d40d4d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:15.301728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e32f5d-bd97-4d0c-8a95-1c8143d40d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:15.326501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-59e32f5d-bd97-4d0c-8a95-1c8143d40d4d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:15.327619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-59e32f5d-bd97-4d0c-8a95-1c8143d40d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:15.396194 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 636/1275] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:22:15.420182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316979bf-a59c-4312-81e8-dfef59c3a6de None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:15.531185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316979bf-a59c-4312-81e8-dfef59c3a6de None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:15.550390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:15.568438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:15.569255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:15.569537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:15.569811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:15.583026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 11:22:15.590505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:15.591708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:15.592611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 640/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Thu Jun 23 11:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:15.598507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e32f5d-bd97-4d0c-8a95-1c8143d40d4d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:15.696281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:15.718492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e32f5d-bd97-4d0c-8a95-1c8143d40d4d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:15.753821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:15.754493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:15.754777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:15.755049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:15.755792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:15.756105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:15.757513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:15.766310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 637/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Thu Jun 23 11:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:15.772182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:15.891029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f2c9-7d88-449a-9425-22eec6573b22 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:15.926064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:15.926851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:15.927125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:15.927392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:15.938909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:15.940347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:15.957396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:15.958396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:15.959661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:15.959661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:15.959661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:15.959661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:15.959661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 641/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:15.967564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:16.077589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32928970-8a0d-4a96-acc1-e848f989d0e7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:16.112593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:16.113276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:16.113567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:16.113833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:16.114549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:16.114858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:16.116230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:16.127751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 638/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:16.133808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:16.174992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:16.249419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ea209-0aea-4af6-bd27-aa588d3cc28c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:16.293679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:16.294580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:16.294860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:16.295134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:16.302830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:16.304636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 11:22:16.320668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:16.321830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:16.323032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 642/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:16.328346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:16.332385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:16.432605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513101-9cd3-4214-9d0d-5585b4531020 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:16.470108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:16.470793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:16.471075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:16.471359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:16.472204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:16.472518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:16.474010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:16.491372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 639/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Thu Jun 23 11:22:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:16.499592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:16.592424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:16.608251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac419-2168-47cb-a867-4c726ba55b9e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:16.648136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:16.648768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:16.649044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:16.649319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:16.719497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:16.720964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:16.819326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:16.833347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 643/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Thu Jun 23 11:22:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 11:22:16.839869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:16.906316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:16.952221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6bf6-3b9d-4e8d-a1f5-b8acc130f5ca None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:16.990189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:16.990908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:16.991180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:16.991454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:17.001720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:17.003158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 11:22:17.021288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:17.022266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:17.023963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 11:22:17.023963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 11:22:17.023963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 11:22:17.023963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:17.023963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 640/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:17.031358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:17.135747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19d78-72fa-48b2-bd37-5603470fcbb3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:17.171858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:17.172510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:17.172820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:17.173095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:17.173820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:17.174125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:17.175502 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:17.187330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 644/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Thu Jun 23 11:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:17.196433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:17.303855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2bab8-d51c-4e1e-a45c-4e8dbe20d99e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:17.317794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:17.343265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:17.344066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:17.344349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:17.344625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:17.351252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:17.352690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 11:22:17.366272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:17.367280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jun 23 11:22:17.368199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 641/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Thu Jun 23 11:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:17.373646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:17.437868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:17.489933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c67150-78f4-4001-a9ee-d79237a65ce2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:17.524451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642725-9f21-48e0-b6bf-195e83daeb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:17.525130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642725-9f21-48e0-b6bf-195e83daeb16 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:17.525405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642725-9f21-48e0-b6bf-195e83daeb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:17.525678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642725-9f21-48e0-b6bf-195e83daeb16 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:17.526464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642725-9f21-48e0-b6bf-195e83daeb16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:17.526761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642725-9f21-48e0-b6bf-195e83daeb16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:17.528178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df642725-9f21-48e0-b6bf-195e83daeb16 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:17.540115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 645/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Thu Jun 23 11:22:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:17.547972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:17.657058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3903739-9b6a-4b6d-b7d1-52a4b001c1d8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:17.698453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e0f2-e2bf-4c1e-8d0c-44c292824520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:17.699096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e0f2-e2bf-4c1e-8d0c-44c292824520 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:17.699375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e0f2-e2bf-4c1e-8d0c-44c292824520 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:17.699645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e0f2-e2bf-4c1e-8d0c-44c292824520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:17.700552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226e0f2-e2bf-4c1e-8d0c-44c292824520 None admin] RBAC: Adding query filter params (role.id=2072cf36ca344da697b097313f411f3b, scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7, user.id=5411be02252b4749be7e1a06d7ddcb45) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:17.700895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226e0f2-e2bf-4c1e-8d0c-44c292824520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:17.702391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226e0f2-e2bf-4c1e-8d0c-44c292824520 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:17.708311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 642/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Thu Jun 23 11:22:17 2022] GET /identity/v3/role_assignments?user.id=5411be02252b4749be7e1a06d7ddcb45&scope.project.id=92c1ca6fca9e44c999e68ff7917b11b7&role.id=2072cf36ca344da697b097313f411f3b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:19.766694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4dc6-4bf9-485c-b8f9-b6f6d1e411cb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:19.767268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4dc6-4bf9-485c-b8f9-b6f6d1e411cb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:19.767268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4dc6-4bf9-485c-b8f9-b6f6d1e411cb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:19.768627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 646/1288] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:19.775831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054234-1468-4279-9483-e4e30f3639fd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:19.776305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054234-1468-4279-9483-e4e30f3639fd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:19.776397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054234-1468-4279-9483-e4e30f3639fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:19.811265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4f054234-1468-4279-9483-e4e30f3639fd None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:19.812795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4f054234-1468-4279-9483-e4e30f3639fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:19.852936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:19.897069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 643/1289] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:22:19.921254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4dc6-4bf9-485c-b8f9-b6f6d1e411cb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:20.034551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4dc6-4bf9-485c-b8f9-b6f6d1e411cb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:20.045293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:20.071305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:20.072117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:20.072397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:20.072671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:20.073350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:20.074723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:20.086840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:20.088009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:20.089065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:20.092913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 647/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:22:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:20.094285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f054234-1468-4279-9483-e4e30f3639fd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:20.197056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f054234-1468-4279-9483-e4e30f3639fd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:20.231853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86399846-7828-48c7-b0f8-56c10b67c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:20.232586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399846-7828-48c7-b0f8-56c10b67c09d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:20.232978 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399846-7828-48c7-b0f8-56c10b67c09d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:20.233258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86399846-7828-48c7-b0f8-56c10b67c09d None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:20.233965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399846-7828-48c7-b0f8-56c10b67c09d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:20.234271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399846-7828-48c7-b0f8-56c10b67c09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:20.235664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86399846-7828-48c7-b0f8-56c10b67c09d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:20.240636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 644/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jun 23 11:22:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:20.246693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:20.353964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c9145-ede5-4251-91bf-58951065301d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:20.388852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3d16d-7975-4cba-8539-e0b2a5c29047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:20.389498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3d16d-7975-4cba-8539-e0b2a5c29047 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:20.389782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3d16d-7975-4cba-8539-e0b2a5c29047 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:20.390052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3d16d-7975-4cba-8539-e0b2a5c29047 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:20.390751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3d16d-7975-4cba-8539-e0b2a5c29047 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:20.391056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3d16d-7975-4cba-8539-e0b2a5c29047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:20.392428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c3d16d-7975-4cba-8539-e0b2a5c29047 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:20.397088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 648/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jun 23 11:22:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:22.400197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeefa4-451d-4feb-bd9c-1cb95f23d3cc None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:22.400773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeefa4-451d-4feb-bd9c-1cb95f23d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:22.400773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeefa4-451d-4feb-bd9c-1cb95f23d3cc None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:22.402087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 645/1293] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:22.408613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469025-db9e-4b2e-9ff5-ed6a27c6c678 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:22.409394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469025-db9e-4b2e-9ff5-ed6a27c6c678 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:22.409560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469025-db9e-4b2e-9ff5-ed6a27c6c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:22.437805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eb469025-db9e-4b2e-9ff5-ed6a27c6c678 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:22.438999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eb469025-db9e-4b2e-9ff5-ed6a27c6c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:22.473766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:22.517483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 649/1294] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:22:22.540706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeefa4-451d-4feb-bd9c-1cb95f23d3cc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:22.575258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:22.653073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeefa4-451d-4feb-bd9c-1cb95f23d3cc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:22.687666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c640-8dc2-4a38-bf52-a5e2e2ca1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:22.688317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c640-8dc2-4a38-bf52-a5e2e2ca1597 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:22.688593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c640-8dc2-4a38-bf52-a5e2e2ca1597 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:22.688895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c640-8dc2-4a38-bf52-a5e2e2ca1597 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:22.689623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883c640-8dc2-4a38-bf52-a5e2e2ca1597 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:22.690979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883c640-8dc2-4a38-bf52-a5e2e2ca1597 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:22.708297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 646/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Thu Jun 23 11:22:22 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:22:24.731312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387d6a6-7b4d-46b3-9768-a128664be7a8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:24.732177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387d6a6-7b4d-46b3-9768-a128664be7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:24.732359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387d6a6-7b4d-46b3-9768-a128664be7a8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:24.734675 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 650/1296] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:24.743407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add86d7-2c75-405b-9358-942f74306f1d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:24.744174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add86d7-2c75-405b-9358-942f74306f1d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:24.744327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add86d7-2c75-405b-9358-942f74306f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:24.763644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8add86d7-2c75-405b-9358-942f74306f1d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:24.764845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8add86d7-2c75-405b-9358-942f74306f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:24.850017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 647/1297] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 11:22:24.876218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387d6a6-7b4d-46b3-9768-a128664be7a8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:24.986113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387d6a6-7b4d-46b3-9768-a128664be7a8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:25.021463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:25.022247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:25.022490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:25.022783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:25.023426 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:25.024792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:25.036792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:25.037806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:25.038727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 651/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:22:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:25.046791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add86d7-2c75-405b-9358-942f74306f1d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:25.067442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:25.152906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add86d7-2c75-405b-9358-942f74306f1d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:25.199078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:25.199744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:25.200034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:25.200634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:25.201165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:25.201474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:25.202855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:25.208206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 648/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jun 23 11:22:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:25.217418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:25.253050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:25.329361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb754e-c6f1-4c12-85af-0bfc0cb7c47a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:25.363736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c12f1a-98a0-48f3-9058-d735b40b5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:25.364369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c12f1a-98a0-48f3-9058-d735b40b5f75 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:25.364644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c12f1a-98a0-48f3-9058-d735b40b5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:25.364947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c12f1a-98a0-48f3-9058-d735b40b5f75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:25.365722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c12f1a-98a0-48f3-9058-d735b40b5f75 None admin] RBAC: Adding query filter params (interface=public, service_id=da08e99762994b0f9fdd1ad9bb31150b, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:25.365998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c12f1a-98a0-48f3-9058-d735b40b5f75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:25.367378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c12f1a-98a0-48f3-9058-d735b40b5f75 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:25.372536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 652/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Thu Jun 23 11:22:25 2022] GET /identity/v3/endpoints?service_id=da08e99762994b0f9fdd1ad9bb31150b&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:22:25.378286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:25.462621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:25.489069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531059b0-b3ed-490d-a1ae-5554f790f60a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:25.536660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636ab18-366b-41eb-992e-5f503ace9c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:25.537385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ab18-366b-41eb-992e-5f503ace9c70 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:25.537666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ab18-366b-41eb-992e-5f503ace9c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:25.537942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636ab18-366b-41eb-992e-5f503ace9c70 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:25.538622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ab18-366b-41eb-992e-5f503ace9c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:25.539998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636ab18-366b-41eb-992e-5f503ace9c70 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:25.547360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 649/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Thu Jun 23 11:22:25 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:22:27.552039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000884bb-86b7-4e3d-ab1a-2171787940fc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:27.552598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000884bb-86b7-4e3d-ab1a-2171787940fc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:27.552598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000884bb-86b7-4e3d-ab1a-2171787940fc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:27.554315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 653/1302] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:22:27.561018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda7f6e-dae1-4150-a3a8-de2bb4b03ff8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:27.561585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda7f6e-dae1-4150-a3a8-de2bb4b03ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:27.561772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda7f6e-dae1-4150-a3a8-de2bb4b03ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:27.590137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2dda7f6e-dae1-4150-a3a8-de2bb4b03ff8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:22:27.591671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2dda7f6e-dae1-4150-a3a8-de2bb4b03ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:22:27.666196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 650/1303] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:22:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 11:22:27.697358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000884bb-86b7-4e3d-ab1a-2171787940fc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:27.813096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:27.820965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000884bb-86b7-4e3d-ab1a-2171787940fc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:27.856346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:27.857165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:27.857445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:27.857712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:27.858356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:27.859797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 11:22:27.871735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 11:22:27.872897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jun 23 11:22:27.873860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 654/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Thu Jun 23 11:22:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 11:22:27.879304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda7f6e-dae1-4150-a3a8-de2bb4b03ff8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:27.966801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:27.993572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda7f6e-dae1-4150-a3a8-de2bb4b03ff8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:28.031257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30734927-8953-4c1d-940c-ff65091eadd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:28.031914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30734927-8953-4c1d-940c-ff65091eadd4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:28.032196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30734927-8953-4c1d-940c-ff65091eadd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:28.032462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30734927-8953-4c1d-940c-ff65091eadd4 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:28.033198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30734927-8953-4c1d-940c-ff65091eadd4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:22:28.033502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30734927-8953-4c1d-940c-ff65091eadd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:28.034873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30734927-8953-4c1d-940c-ff65091eadd4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:28.040089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 651/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Thu Jun 23 11:22:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:22:28.046935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:22:28.149703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9cb50-851c-41c6-b2a1-6893927d1963 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:22:28.185043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042a3db-9394-45d6-a3ea-3ca04faf57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:22:28.185690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a3db-9394-45d6-a3ea-3ca04faf57d2 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:22:28.185965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a3db-9394-45d6-a3ea-3ca04faf57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:22:28.186235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042a3db-9394-45d6-a3ea-3ca04faf57d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:22:28.186973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042a3db-9394-45d6-a3ea-3ca04faf57d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:22:28.188347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042a3db-9394-45d6-a3ea-3ca04faf57d2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:22:28.210368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 655/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Thu Jun 23 11:22:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:22:38.036919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=30 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:22:38.205724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:31.561893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb4df8-0162-4725-879f-a033d35028ed None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:31.562431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb4df8-0162-4725-879f-a033d35028ed None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:31.562431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb4df8-0162-4725-879f-a033d35028ed None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:31.563849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 652/1307] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:31.569286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1d90-602b-4e31-bc52-ca00c3234bb8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:31.569733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1d90-602b-4e31-bc52-ca00c3234bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:31.569943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c1d90-602b-4e31-bc52-ca00c3234bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:31.747439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5d0c1d90-602b-4e31-bc52-ca00c3234bb8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:31.748629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5d0c1d90-602b-4e31-bc52-ca00c3234bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:31.941669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 656/1308] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:31.980377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568b7a-1d50-4d36-aaed-325dc1ed07ed None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:31.980818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568b7a-1d50-4d36-aaed-325dc1ed07ed None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:31.981106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3568b7a-1d50-4d36-aaed-325dc1ed07ed None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:31.982798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 653/1309] 10.222.0.66 () {54 vars in 964 bytes} [Thu Jun 23 11:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:31.988769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6133b13-8422-46e1-aa77-ae3b06f84ac3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:31.989979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6133b13-8422-46e1-aa77-ae3b06f84ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:31.990520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6133b13-8422-46e1-aa77-ae3b06f84ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:32.082504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d6133b13-8422-46e1-aa77-ae3b06f84ac3 None None] MFA Rules not processed for user `795571c4c2cc4f969ce487c0ec6dfbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:32.084288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d6133b13-8422-46e1-aa77-ae3b06f84ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:32.106076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:32.166358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 657/1310] 10.222.0.66 () {58 vars in 1061 bytes} [Thu Jun 23 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:32.175687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3568b7a-1d50-4d36-aaed-325dc1ed07ed None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:32.177510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3568b7a-1d50-4d36-aaed-325dc1ed07ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:32.289883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3568b7a-1d50-4d36-aaed-325dc1ed07ed None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:32.374768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de2526-bb32-4c06-99b6-7a37fdc09f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:32.375350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2526-bb32-4c06-99b6-7a37fdc09f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:32.375627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2526-bb32-4c06-99b6-7a37fdc09f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:32.375893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2526-bb32-4c06-99b6-7a37fdc09f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:32.377633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-90de2526-bb32-4c06-99b6-7a37fdc09f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:32.445743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:32.519197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de2526-bb32-4c06-99b6-7a37fdc09f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:32.521545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de2526-bb32-4c06-99b6-7a37fdc09f68 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:32.556795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 654/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:34.882159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52757843-98ac-491e-a551-6940617d0adb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:34.882770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52757843-98ac-491e-a551-6940617d0adb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:34.883106 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52757843-98ac-491e-a551-6940617d0adb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:34.884557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 658/1312] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:34.890016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588ff2-40c2-42e7-847e-13e125ea4c97 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:34.890436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588ff2-40c2-42e7-847e-13e125ea4c97 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:34.890547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588ff2-40c2-42e7-847e-13e125ea4c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:34.967062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ce588ff2-40c2-42e7-847e-13e125ea4c97 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:34.968292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ce588ff2-40c2-42e7-847e-13e125ea4c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:35.086644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 655/1313] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:35.140582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd90f-6e2d-4c4d-bbef-6466a0ad2899 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:35.140827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd90f-6e2d-4c4d-bbef-6466a0ad2899 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:35.141113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd90f-6e2d-4c4d-bbef-6466a0ad2899 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:35.142500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 659/1314] 10.222.0.66 () {54 vars in 964 bytes} [Thu Jun 23 11:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:35.149028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e934-9086-4139-8bdd-c39327b2bc30 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:35.149355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e934-9086-4139-8bdd-c39327b2bc30 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:35.149636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9e934-9086-4139-8bdd-c39327b2bc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:35.161276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:35.231930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-75d9e934-9086-4139-8bdd-c39327b2bc30 None None] MFA Rules not processed for user `795571c4c2cc4f969ce487c0ec6dfbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:35.233178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-75d9e934-9086-4139-8bdd-c39327b2bc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:35.311481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 656/1315] 10.222.0.66 () {58 vars in 1061 bytes} [Thu Jun 23 11:23:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:35.320793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cd90f-6e2d-4c4d-bbef-6466a0ad2899 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:35.322384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-623cd90f-6e2d-4c4d-bbef-6466a0ad2899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:35.433340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cd90f-6e2d-4c4d-bbef-6466a0ad2899 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:35.508248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:35.511064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f302b2f-2f30-4ff4-8724-d0804f2ef605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:35.512203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302b2f-2f30-4ff4-8724-d0804f2ef605 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:35.512804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302b2f-2f30-4ff4-8724-d0804f2ef605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:35.513207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f302b2f-2f30-4ff4-8724-d0804f2ef605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:35.514857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8f302b2f-2f30-4ff4-8724-d0804f2ef605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:35.633865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f302b2f-2f30-4ff4-8724-d0804f2ef605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:35.635304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f302b2f-2f30-4ff4-8724-d0804f2ef605 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:35.656021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 660/1316] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:38.244251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a46d0-105d-4e5b-b54d-9d850f09e980 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:38.244856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a46d0-105d-4e5b-b54d-9d850f09e980 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:38.244856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a46d0-105d-4e5b-b54d-9d850f09e980 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:38.246723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 657/1317] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:38.252264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003424a-2a73-432a-8b60-5107938a67e8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:38.252751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003424a-2a73-432a-8b60-5107938a67e8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:38.252846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003424a-2a73-432a-8b60-5107938a67e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:38.323388 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7003424a-2a73-432a-8b60-5107938a67e8 None None] MFA Rules not processed for user `7cef473d3c5b4a9a8c54a0d160cca389`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:38.324612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7003424a-2a73-432a-8b60-5107938a67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:38.380510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:38.430718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 661/1318] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:38.471245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a46d0-105d-4e5b-b54d-9d850f09e980 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:38.473709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1d3a46d0-105d-4e5b-b54d-9d850f09e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:38.608145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a46d0-105d-4e5b-b54d-9d850f09e980 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:38.610908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:38.686926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c9121-cce0-42a1-a55d-3a5548ff0407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:38.687568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c9121-cce0-42a1-a55d-3a5548ff0407 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:38.687851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c9121-cce0-42a1-a55d-3a5548ff0407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:38.688132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c9121-cce0-42a1-a55d-3a5548ff0407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:38.689814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-713c9121-cce0-42a1-a55d-3a5548ff0407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:38.824468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c9121-cce0-42a1-a55d-3a5548ff0407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:38.825694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c9121-cce0-42a1-a55d-3a5548ff0407 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:38.845280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 658/1319] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:41.650496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcce4-4b10-425c-aae2-739c5bd8800f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:41.651073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcce4-4b10-425c-aae2-739c5bd8800f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:41.651073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bcce4-4b10-425c-aae2-739c5bd8800f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:41.652592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 662/1320] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:41.659138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3f275-230b-4bcf-9994-2f6fd2f05b9c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:41.660023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3f275-230b-4bcf-9994-2f6fd2f05b9c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:41.660023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3f275-230b-4bcf-9994-2f6fd2f05b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:41.704387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:41.731047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-52e3f275-230b-4bcf-9994-2f6fd2f05b9c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:41.732263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-52e3f275-230b-4bcf-9994-2f6fd2f05b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:41.853979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 659/1321] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:41.894139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcce4-4b10-425c-aae2-739c5bd8800f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:41.895722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-954bcce4-4b10-425c-aae2-739c5bd8800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:42.007240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bcce4-4b10-425c-aae2-739c5bd8800f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:42.096108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4f0f4-21d7-4060-ae7d-1502fb6da950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:42.096817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f0f4-21d7-4060-ae7d-1502fb6da950 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:42.097093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f0f4-21d7-4060-ae7d-1502fb6da950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:42.097362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f0f4-21d7-4060-ae7d-1502fb6da950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:42.099021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fba4f0f4-21d7-4060-ae7d-1502fb6da950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:42.107143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:42.216092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4f0f4-21d7-4060-ae7d-1502fb6da950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:42.217571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4f0f4-21d7-4060-ae7d-1502fb6da950 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:42.236529 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 663/1322] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:45.044705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168498-102e-4252-9d22-08e04638f0da None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:45.045273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168498-102e-4252-9d22-08e04638f0da None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:45.045273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168498-102e-4252-9d22-08e04638f0da None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:45.046874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 660/1323] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:23:45.052900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249c125-e2ef-49e2-8b06-5d28ffdb30b1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:45.053364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249c125-e2ef-49e2-8b06-5d28ffdb30b1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:45.053512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249c125-e2ef-49e2-8b06-5d28ffdb30b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:45.118783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5249c125-e2ef-49e2-8b06-5d28ffdb30b1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:45.119945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5249c125-e2ef-49e2-8b06-5d28ffdb30b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:45.186604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:45.233417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 664/1324] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:45.272823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168498-102e-4252-9d22-08e04638f0da None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:45.275236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-27168498-102e-4252-9d22-08e04638f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:45.394712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168498-102e-4252-9d22-08e04638f0da None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:45.407490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:45.475716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59e57a-ce1c-4600-8d10-42eab8349eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:45.476368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59e57a-ce1c-4600-8d10-42eab8349eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:45.476650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59e57a-ce1c-4600-8d10-42eab8349eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:45.476962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59e57a-ce1c-4600-8d10-42eab8349eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:45.478603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1d59e57a-ce1c-4600-8d10-42eab8349eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:45.594564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59e57a-ce1c-4600-8d10-42eab8349eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:45.595885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59e57a-ce1c-4600-8d10-42eab8349eb5 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:45.614647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 661/1325] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:47.728668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0a66-a616-441a-84fb-76450e050d77 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:47.729243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0a66-a616-441a-84fb-76450e050d77 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:47.729243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0a66-a616-441a-84fb-76450e050d77 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:47.730773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 665/1326] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:47.736345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067210a-ecc2-4475-a1e2-12ffc707c1bd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:47.736796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067210a-ecc2-4475-a1e2-12ffc707c1bd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:47.752798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067210a-ecc2-4475-a1e2-12ffc707c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:47.804623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:47.823312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a067210a-ecc2-4475-a1e2-12ffc707c1bd None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:47.825093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a067210a-ecc2-4475-a1e2-12ffc707c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:47.923169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 662/1327] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:23:47.959394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0a66-a616-441a-84fb-76450e050d77 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:47.961015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-62ba0a66-a616-441a-84fb-76450e050d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:48.076169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0a66-a616-441a-84fb-76450e050d77 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:48.155789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dab06-b830-4ca1-8d30-0699c7d0abf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:48.156438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dab06-b830-4ca1-8d30-0699c7d0abf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:48.156742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dab06-b830-4ca1-8d30-0699c7d0abf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:48.157013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dab06-b830-4ca1-8d30-0699c7d0abf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:48.158656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-461dab06-b830-4ca1-8d30-0699c7d0abf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:48.175137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:48.277480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dab06-b830-4ca1-8d30-0699c7d0abf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:48.278955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dab06-b830-4ca1-8d30-0699c7d0abf8 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:48.298633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 666/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:50.379814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caaa33-389e-4bb7-8cae-ddf9098db955 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:50.380423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caaa33-389e-4bb7-8cae-ddf9098db955 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:50.380423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51caaa33-389e-4bb7-8cae-ddf9098db955 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:50.381686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 663/1329] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:50.387476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22a52-46bf-4d21-b915-59635434e4ab None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:50.388013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22a52-46bf-4d21-b915-59635434e4ab None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:50.388013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be22a52-46bf-4d21-b915-59635434e4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:50.461874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3be22a52-46bf-4d21-b915-59635434e4ab None None] MFA Rules not processed for user `7cef473d3c5b4a9a8c54a0d160cca389`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:50.463180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3be22a52-46bf-4d21-b915-59635434e4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:50.536889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:50.570028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 667/1330] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:50.608018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caaa33-389e-4bb7-8cae-ddf9098db955 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:50.609600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-51caaa33-389e-4bb7-8cae-ddf9098db955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:50.718786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51caaa33-389e-4bb7-8cae-ddf9098db955 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:50.740032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:50.795066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ffaf9-ecb1-42b3-ad7e-e5dda417e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:50.795718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ffaf9-ecb1-42b3-ad7e-e5dda417e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:50.795996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ffaf9-ecb1-42b3-ad7e-e5dda417e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:50.796268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ffaf9-ecb1-42b3-ad7e-e5dda417e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:50.797951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-442ffaf9-ecb1-42b3-ad7e-e5dda417e0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:50.920396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ffaf9-ecb1-42b3-ad7e-e5dda417e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:50.921888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ffaf9-ecb1-42b3-ad7e-e5dda417e0c4 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:50.943953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 664/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:53.289569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab57434-b576-4c07-9ec2-97dc3ad9f395 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:53.290462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab57434-b576-4c07-9ec2-97dc3ad9f395 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:53.290462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab57434-b576-4c07-9ec2-97dc3ad9f395 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:53.292645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 668/1332] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:53.301862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef2eae-2d0f-4ec9-b2d0-404bcfe70ec6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:53.302621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef2eae-2d0f-4ec9-b2d0-404bcfe70ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:53.302778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef2eae-2d0f-4ec9-b2d0-404bcfe70ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:53.367886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:53.370722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-37ef2eae-2d0f-4ec9-b2d0-404bcfe70ec6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:53.372873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-37ef2eae-2d0f-4ec9-b2d0-404bcfe70ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:53.484205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 665/1333] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:53.522938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab57434-b576-4c07-9ec2-97dc3ad9f395 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:53.524497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0ab57434-b576-4c07-9ec2-97dc3ad9f395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:53.640540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab57434-b576-4c07-9ec2-97dc3ad9f395 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:53.715176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545e7b2-2cd7-4500-a5c2-8c102f0b0413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:53.715824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e7b2-2cd7-4500-a5c2-8c102f0b0413 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:53.716104 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e7b2-2cd7-4500-a5c2-8c102f0b0413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:53.716385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545e7b2-2cd7-4500-a5c2-8c102f0b0413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:53.718079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6545e7b2-2cd7-4500-a5c2-8c102f0b0413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:53.747035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:53.849273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545e7b2-2cd7-4500-a5c2-8c102f0b0413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:53.850732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545e7b2-2cd7-4500-a5c2-8c102f0b0413 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:53.869315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 669/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:55.951822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225a18f-2acc-4db9-b84e-2023ae84663e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:55.952407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225a18f-2acc-4db9-b84e-2023ae84663e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:55.952407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225a18f-2acc-4db9-b84e-2023ae84663e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:55.954086 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 666/1335] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:55.959527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2830b0-7dc5-4b4e-904f-1d42ba8a53f3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:55.959950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2830b0-7dc5-4b4e-904f-1d42ba8a53f3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:55.960059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2830b0-7dc5-4b4e-904f-1d42ba8a53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:56.025780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7c2830b0-7dc5-4b4e-904f-1d42ba8a53f3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:56.027092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7c2830b0-7dc5-4b4e-904f-1d42ba8a53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:56.108157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:56.133505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 670/1336] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:56.177667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225a18f-2acc-4db9-b84e-2023ae84663e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:56.179165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9225a18f-2acc-4db9-b84e-2023ae84663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:56.289778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225a18f-2acc-4db9-b84e-2023ae84663e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:56.318846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:56.364203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37474e-965b-4dff-8b06-5c280fae74e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:56.364881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37474e-965b-4dff-8b06-5c280fae74e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:56.365163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37474e-965b-4dff-8b06-5c280fae74e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:56.365443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37474e-965b-4dff-8b06-5c280fae74e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:56.367073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1c37474e-965b-4dff-8b06-5c280fae74e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:56.481571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37474e-965b-4dff-8b06-5c280fae74e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:56.482999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37474e-965b-4dff-8b06-5c280fae74e2 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:56.501197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 667/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:58.891814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c718-604e-4daf-93cd-ca70ceee229e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:58.892362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c718-604e-4daf-93cd-ca70ceee229e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:58.892362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2c718-604e-4daf-93cd-ca70ceee229e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:58.893746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 671/1338] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:23:58.899711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc781-88a7-4d89-8740-1fbef9f649bb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:58.900251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc781-88a7-4d89-8740-1fbef9f649bb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:58.900251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc781-88a7-4d89-8740-1fbef9f649bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:58.970569 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c9ebc781-88a7-4d89-8740-1fbef9f649bb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:23:58.971787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c9ebc781-88a7-4d89-8740-1fbef9f649bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:58.980542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:59.084948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 668/1339] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:23:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:23:59.122430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2c718-604e-4daf-93cd-ca70ceee229e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:59.123985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f4b2c718-604e-4daf-93cd-ca70ceee229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:59.247226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2c718-604e-4daf-93cd-ca70ceee229e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:59.337419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303c7f0-7c3a-4f6d-b694-99da16c52734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:59.338314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303c7f0-7c3a-4f6d-b694-99da16c52734 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:59.338890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303c7f0-7c3a-4f6d-b694-99da16c52734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:59.339496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303c7f0-7c3a-4f6d-b694-99da16c52734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:59.341180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c303c7f0-7c3a-4f6d-b694-99da16c52734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:59.379757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:59.466794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303c7f0-7c3a-4f6d-b694-99da16c52734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:59.468242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303c7f0-7c3a-4f6d-b694-99da16c52734 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:59.491456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 672/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:03.674267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebfa8d-920f-4c76-9000-a16db273c816 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:03.674854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebfa8d-920f-4c76-9000-a16db273c816 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:03.674854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebfa8d-920f-4c76-9000-a16db273c816 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:03.676177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 669/1341] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:03.681878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8774003-2017-47f9-8cb8-30c3d54b4c38 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:03.682336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8774003-2017-47f9-8cb8-30c3d54b4c38 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:03.682336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8774003-2017-47f9-8cb8-30c3d54b4c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:03.767034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b8774003-2017-47f9-8cb8-30c3d54b4c38 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:03.768275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b8774003-2017-47f9-8cb8-30c3d54b4c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:03.875717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:24:03.891164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 673/1342] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:03.935459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebfa8d-920f-4c76-9000-a16db273c816 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:03.938225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-19ebfa8d-920f-4c76-9000-a16db273c816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:04.040637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebfa8d-920f-4c76-9000-a16db273c816 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:04.045312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2c5dc-f5df-4fac-83de-3110a06a4eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:04.045974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c5dc-f5df-4fac-83de-3110a06a4eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:04.046452 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c5dc-f5df-4fac-83de-3110a06a4eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:04.046771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c5dc-f5df-4fac-83de-3110a06a4eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:04.060206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2c5dc-f5df-4fac-83de-3110a06a4eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:04.061688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2c5dc-f5df-4fac-83de-3110a06a4eb6 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:04.071836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 670/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:06.721816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d05121-08e1-49a0-b4ba-1575e466d6f9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:06.722383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d05121-08e1-49a0-b4ba-1575e466d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:06.722383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d05121-08e1-49a0-b4ba-1575e466d6f9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:06.723735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 674/1344] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:06.729438 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3ce4-36ca-4e92-83ca-ecaf5ebb8020 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:06.729863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3ce4-36ca-4e92-83ca-ecaf5ebb8020 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:06.730039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3ce4-36ca-4e92-83ca-ecaf5ebb8020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:06.759687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-580e3ce4-36ca-4e92-83ca-ecaf5ebb8020 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:06.760913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-580e3ce4-36ca-4e92-83ca-ecaf5ebb8020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:06.795049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:24:06.850128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 671/1345] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:06.889608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d05121-08e1-49a0-b4ba-1575e466d6f9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:06.891547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-94d05121-08e1-49a0-b4ba-1575e466d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:06.906066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d05121-08e1-49a0-b4ba-1575e466d6f9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:06.910081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae852da-72a5-4dfd-920b-09bbe252942c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:06.910815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae852da-72a5-4dfd-920b-09bbe252942c service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:06.911163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae852da-72a5-4dfd-920b-09bbe252942c service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:06.911508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae852da-72a5-4dfd-920b-09bbe252942c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:06.922391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae852da-72a5-4dfd-920b-09bbe252942c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:06.924152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae852da-72a5-4dfd-920b-09bbe252942c service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:06.935143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 675/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:10.929519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e799c-c4e9-473d-98d0-5fd19bcd166f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:10.930080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e799c-c4e9-473d-98d0-5fd19bcd166f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:10.930192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e799c-c4e9-473d-98d0-5fd19bcd166f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:10.932010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 672/1347] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:10.937299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795c688-61e3-4fda-a410-4822caa7fe6c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:10.937758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795c688-61e3-4fda-a410-4822caa7fe6c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:10.937850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795c688-61e3-4fda-a410-4822caa7fe6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:10.955847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d795c688-61e3-4fda-a410-4822caa7fe6c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:10.957100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d795c688-61e3-4fda-a410-4822caa7fe6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:10.965200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 676/1348] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:11.003276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e799c-c4e9-473d-98d0-5fd19bcd166f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:11.015282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e799c-c4e9-473d-98d0-5fd19bcd166f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:11.019028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0da1d-b556-4a28-b5ad-eb284b36636c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:11.019734 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0da1d-b556-4a28-b5ad-eb284b36636c service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:11.020088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0da1d-b556-4a28-b5ad-eb284b36636c service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:11.020355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0da1d-b556-4a28-b5ad-eb284b36636c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:11.031038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0da1d-b556-4a28-b5ad-eb284b36636c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:11.032475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0da1d-b556-4a28-b5ad-eb284b36636c service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:11.043620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 673/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:24:16.005425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e9105-c3f0-452e-a96d-8c85e480d526 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:16.005863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e9105-c3f0-452e-a96d-8c85e480d526 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:16.006242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e9105-c3f0-452e-a96d-8c85e480d526 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:16.007969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 677/1350] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:16.013618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ca6a-0fb4-453a-bc19-2692414caee9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:16.014015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ca6a-0fb4-453a-bc19-2692414caee9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:16.014356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ca6a-0fb4-453a-bc19-2692414caee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:16.103701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2463ca6a-0fb4-453a-bc19-2692414caee9 None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:16.105467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2463ca6a-0fb4-453a-bc19-2692414caee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:16.187918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 674/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:24:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:24:20.549259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac385ba-7702-429f-85bd-623f56b95c70 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:20.549836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac385ba-7702-429f-85bd-623f56b95c70 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:20.549836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac385ba-7702-429f-85bd-623f56b95c70 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:20.551178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 678/1352] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:20.556626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f58b8-1475-4882-a87b-1425442eac60 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:20.557546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f58b8-1475-4882-a87b-1425442eac60 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:20.557918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f58b8-1475-4882-a87b-1425442eac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:20.577877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1b1f58b8-1475-4882-a87b-1425442eac60 None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:20.579175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1b1f58b8-1475-4882-a87b-1425442eac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:20.588077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 675/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:24:20.952511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=13 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:24:21.942869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a11fc-80c5-429e-9fae-7dd9ce4f1d0a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:21.943514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a11fc-80c5-429e-9fae-7dd9ce4f1d0a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:21.943715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a11fc-80c5-429e-9fae-7dd9ce4f1d0a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:21.945252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 679/1354] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:21.950620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbbaa3-e6a3-43cc-a893-2ad2e27b7771 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:21.951067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbbaa3-e6a3-43cc-a893-2ad2e27b7771 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:21.951268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbbaa3-e6a3-43cc-a893-2ad2e27b7771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:21.969421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-40fbbaa3-e6a3-43cc-a893-2ad2e27b7771 None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:21.970617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-40fbbaa3-e6a3-43cc-a893-2ad2e27b7771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:21.979844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 676/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:25.702595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b107cb-ddbf-4ca2-ad51-87b4dc1bd74b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:25.703124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b107cb-ddbf-4ca2-ad51-87b4dc1bd74b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:25.703389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b107cb-ddbf-4ca2-ad51-87b4dc1bd74b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:25.706870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 680/1356] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:25.713491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d744-fe22-4e87-90da-97e3697459d4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:25.714432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d744-fe22-4e87-90da-97e3697459d4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:25.715913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422d744-fe22-4e87-90da-97e3697459d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:25.744272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6422d744-fe22-4e87-90da-97e3697459d4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:25.746790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6422d744-fe22-4e87-90da-97e3697459d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:25.759589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 677/1357] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:25.817791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2237aa-afcf-482b-9dde-5aa53330ceb8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:25.818514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2237aa-afcf-482b-9dde-5aa53330ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:25.819127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2237aa-afcf-482b-9dde-5aa53330ceb8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:25.820795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 681/1358] 10.222.0.66 () {54 vars in 961 bytes} [Thu Jun 23 11:24:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:25.830609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48badb2-d51a-46e4-b7fc-9aa182f0929f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:25.830826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48badb2-d51a-46e4-b7fc-9aa182f0929f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:25.831096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48badb2-d51a-46e4-b7fc-9aa182f0929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:25.878625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:24:25.888390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c48badb2-d51a-46e4-b7fc-9aa182f0929f None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:25.889726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c48badb2-d51a-46e4-b7fc-9aa182f0929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:25.979684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 678/1359] 10.222.0.66 () {58 vars in 1058 bytes} [Thu Jun 23 11:24:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:25.987572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2237aa-afcf-482b-9dde-5aa53330ceb8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:26.003072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2237aa-afcf-482b-9dde-5aa53330ceb8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:26.009180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5db41-b22d-441f-afc7-ee0aa45985f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:26.010019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5db41-b22d-441f-afc7-ee0aa45985f8 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:26.010455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5db41-b22d-441f-afc7-ee0aa45985f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:26.010986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5db41-b22d-441f-afc7-ee0aa45985f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:26.021743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5db41-b22d-441f-afc7-ee0aa45985f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:26.023543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5db41-b22d-441f-afc7-ee0aa45985f8 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:26.034730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 682/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:24:28.285553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34a40b-07a3-4e72-98d7-a71babadeff9 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:28.286078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34a40b-07a3-4e72-98d7-a71babadeff9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:28.286078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34a40b-07a3-4e72-98d7-a71babadeff9 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:28.287661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 679/1361] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:28.293416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346ac0a-9b0e-48a8-9f0e-b3d9dc9e1b52 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:28.293915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346ac0a-9b0e-48a8-9f0e-b3d9dc9e1b52 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:28.293915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346ac0a-9b0e-48a8-9f0e-b3d9dc9e1b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:28.313603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d346ac0a-9b0e-48a8-9f0e-b3d9dc9e1b52 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:28.314737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d346ac0a-9b0e-48a8-9f0e-b3d9dc9e1b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:28.324119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 683/1362] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:28.369439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34a40b-07a3-4e72-98d7-a71babadeff9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:28.384099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34a40b-07a3-4e72-98d7-a71babadeff9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:28.389445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efae81f-d34b-41ba-902d-42c099f87970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:28.390085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae81f-d34b-41ba-902d-42c099f87970 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:28.390362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae81f-d34b-41ba-902d-42c099f87970 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:28.390633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efae81f-d34b-41ba-902d-42c099f87970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:28.399239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae81f-d34b-41ba-902d-42c099f87970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:28.401040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efae81f-d34b-41ba-902d-42c099f87970 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:28.410830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 680/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:30.751323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08d752-3915-4d0d-8689-44beaf56b6f7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:30.752100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08d752-3915-4d0d-8689-44beaf56b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:30.752559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08d752-3915-4d0d-8689-44beaf56b6f7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:30.754112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 684/1364] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:30.759523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2885-61e4-4cf2-9c6b-14e3482f022f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:30.759973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2885-61e4-4cf2-9c6b-14e3482f022f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:30.760070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d2885-61e4-4cf2-9c6b-14e3482f022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:30.779200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ff7d2885-61e4-4cf2-9c6b-14e3482f022f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:30.780449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ff7d2885-61e4-4cf2-9c6b-14e3482f022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:30.789693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 681/1365] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:30.835481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374251a-acc0-400c-a2b8-c1c6a55ca890 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:30.835839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374251a-acc0-400c-a2b8-c1c6a55ca890 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:30.836344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374251a-acc0-400c-a2b8-c1c6a55ca890 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:30.838152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 685/1366] 10.222.0.66 () {54 vars in 961 bytes} [Thu Jun 23 11:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:30.843401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d05c5-cfe5-4fc7-8417-a67ce62de146 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:30.843689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d05c5-cfe5-4fc7-8417-a67ce62de146 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:30.843964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d05c5-cfe5-4fc7-8417-a67ce62de146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:30.864862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6a4d05c5-cfe5-4fc7-8417-a67ce62de146 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:30.866077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6a4d05c5-cfe5-4fc7-8417-a67ce62de146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:30.891346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 682/1367] 10.222.0.66 () {58 vars in 1058 bytes} [Thu Jun 23 11:24:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:30.892139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374251a-acc0-400c-a2b8-c1c6a55ca890 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:30.932466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374251a-acc0-400c-a2b8-c1c6a55ca890 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:30.937875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159a8b1-5f27-4286-92c3-644f888f08c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:30.938547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159a8b1-5f27-4286-92c3-644f888f08c7 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:30.938838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159a8b1-5f27-4286-92c3-644f888f08c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:30.939086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159a8b1-5f27-4286-92c3-644f888f08c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:30.947680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159a8b1-5f27-4286-92c3-644f888f08c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:30.949292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159a8b1-5f27-4286-92c3-644f888f08c7 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:30.958524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 686/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:33.086898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0972-a580-4327-b29c-9d1b6a85569c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:33.087503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0972-a580-4327-b29c-9d1b6a85569c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:33.087837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f0972-a580-4327-b29c-9d1b6a85569c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:33.099567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 683/1369] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:33.105412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c1f7-b5ed-4828-9ae0-2e73fb12eb8b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:33.105937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c1f7-b5ed-4828-9ae0-2e73fb12eb8b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:33.105937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c1f7-b5ed-4828-9ae0-2e73fb12eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:33.126358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c207c1f7-b5ed-4828-9ae0-2e73fb12eb8b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:33.127739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c207c1f7-b5ed-4828-9ae0-2e73fb12eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:33.137576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 687/1370] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:33.189101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f0972-a580-4327-b29c-9d1b6a85569c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:33.206794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f0972-a580-4327-b29c-9d1b6a85569c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:33.214481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34329c-cf4d-4b56-a6b7-e13133648595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:33.215264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34329c-cf4d-4b56-a6b7-e13133648595 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:33.215659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34329c-cf4d-4b56-a6b7-e13133648595 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:33.216034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34329c-cf4d-4b56-a6b7-e13133648595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:33.228150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34329c-cf4d-4b56-a6b7-e13133648595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:33.230041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34329c-cf4d-4b56-a6b7-e13133648595 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:33.252623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 684/1371] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:33.884547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631d94-97c4-421b-a7d8-d4a4c6874dcb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:33.884853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631d94-97c4-421b-a7d8-d4a4c6874dcb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:33.885126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0631d94-97c4-421b-a7d8-d4a4c6874dcb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:33.886562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 688/1372] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:33.892363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5b30-2959-4596-81ac-774a376c8b45 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:33.892623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5b30-2959-4596-81ac-774a376c8b45 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:33.892933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5b30-2959-4596-81ac-774a376c8b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:33.912343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d03b5b30-2959-4596-81ac-774a376c8b45 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:33.913969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d03b5b30-2959-4596-81ac-774a376c8b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:33.924864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 685/1373] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:24:34.267940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2adb-dde9-45f2-a957-7a5b2f2d2e84 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:34.268432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2adb-dde9-45f2-a957-7a5b2f2d2e84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:34.268590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d2adb-dde9-45f2-a957-7a5b2f2d2e84 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:34.269897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 689/1374] 10.222.0.66 () {54 vars in 963 bytes} [Thu Jun 23 11:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:34.275221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f491-4cbb-4a75-a74d-a03e00a950d1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:34.275742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f491-4cbb-4a75-a74d-a03e00a950d1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:34.275946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8f491-4cbb-4a75-a74d-a03e00a950d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:34.325870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b7f8f491-4cbb-4a75-a74d-a03e00a950d1 None None] MFA Rules not processed for user `ab171a27a8d043869eddc76d2befe09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:34.327104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b7f8f491-4cbb-4a75-a74d-a03e00a950d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:34.394248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 686/1375] 10.222.0.66 () {58 vars in 1060 bytes} [Thu Jun 23 11:24:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:34.404664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2adb-dde9-45f2-a957-7a5b2f2d2e84 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:34.417057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d2adb-dde9-45f2-a957-7a5b2f2d2e84 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:34.420765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c026c6-99df-45e4-8bf5-8b670c0df49a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:34.421900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c026c6-99df-45e4-8bf5-8b670c0df49a service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:34.422327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c026c6-99df-45e4-8bf5-8b670c0df49a service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:34.422740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c026c6-99df-45e4-8bf5-8b670c0df49a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:34.432506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c026c6-99df-45e4-8bf5-8b670c0df49a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:34.434175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c026c6-99df-45e4-8bf5-8b670c0df49a service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:34.444644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 690/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:35.326047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9040-2ef4-4b0f-8945-d43b8a0a8333 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:35.326695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9040-2ef4-4b0f-8945-d43b8a0a8333 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:35.326695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9040-2ef4-4b0f-8945-d43b8a0a8333 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:35.328176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 687/1377] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:35.333615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcc920-6fe2-4bfa-8c3f-85885713d113 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:35.334228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcc920-6fe2-4bfa-8c3f-85885713d113 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:35.334228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bcc920-6fe2-4bfa-8c3f-85885713d113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:35.353343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-81bcc920-6fe2-4bfa-8c3f-85885713d113 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:35.354964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-81bcc920-6fe2-4bfa-8c3f-85885713d113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:35.363587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 691/1378] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:35.408559 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9040-2ef4-4b0f-8945-d43b8a0a8333 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:35.424081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9040-2ef4-4b0f-8945-d43b8a0a8333 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:35.429535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06830d-e56b-4ea5-8ded-f12086150be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:35.430183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06830d-e56b-4ea5-8ded-f12086150be1 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:35.430554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06830d-e56b-4ea5-8ded-f12086150be1 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:35.430899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06830d-e56b-4ea5-8ded-f12086150be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:35.439743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06830d-e56b-4ea5-8ded-f12086150be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:35.441387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06830d-e56b-4ea5-8ded-f12086150be1 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:35.445314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:24:35.452470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 688/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:37.510499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cbba9-1bb0-4f8b-98f2-c292cb5c2f2d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:37.511039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cbba9-1bb0-4f8b-98f2-c292cb5c2f2d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:37.511039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cbba9-1bb0-4f8b-98f2-c292cb5c2f2d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:37.512461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 692/1380] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:37.518022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf038a-54db-4530-addb-f73f346ee294 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:37.518442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf038a-54db-4530-addb-f73f346ee294 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:37.518579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf038a-54db-4530-addb-f73f346ee294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:37.537693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-eeaf038a-54db-4530-addb-f73f346ee294 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:37.538830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-eeaf038a-54db-4530-addb-f73f346ee294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:37.547064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 689/1381] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:37.592285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cbba9-1bb0-4f8b-98f2-c292cb5c2f2d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:37.607984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cbba9-1bb0-4f8b-98f2-c292cb5c2f2d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:37.614525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3838e-1ab0-45b9-86e0-2102474e4f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:37.615180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3838e-1ab0-45b9-86e0-2102474e4f82 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:37.615460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3838e-1ab0-45b9-86e0-2102474e4f82 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:37.615731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3838e-1ab0-45b9-86e0-2102474e4f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:37.624244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3838e-1ab0-45b9-86e0-2102474e4f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:37.626027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3838e-1ab0-45b9-86e0-2102474e4f82 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:37.635979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 693/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:39.688783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87047-d39a-4013-b15d-a17adad0a0d6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:39.689336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87047-d39a-4013-b15d-a17adad0a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:39.689336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87047-d39a-4013-b15d-a17adad0a0d6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:39.690718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 690/1383] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:39.696292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbd0c8-b636-4b4a-8142-4692705cfe6e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:39.696910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbd0c8-b636-4b4a-8142-4692705cfe6e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:39.696910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbd0c8-b636-4b4a-8142-4692705cfe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:39.715811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4abbd0c8-b636-4b4a-8142-4692705cfe6e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:39.717046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4abbd0c8-b636-4b4a-8142-4692705cfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:39.725453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 694/1384] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:39.767913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87047-d39a-4013-b15d-a17adad0a0d6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:39.783378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e87047-d39a-4013-b15d-a17adad0a0d6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:39.789035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79e35-1b66-435c-a0f8-298bfc4d71d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:39.789714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79e35-1b66-435c-a0f8-298bfc4d71d6 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:39.789984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79e35-1b66-435c-a0f8-298bfc4d71d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:39.790278 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79e35-1b66-435c-a0f8-298bfc4d71d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:39.800586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79e35-1b66-435c-a0f8-298bfc4d71d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:39.802654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79e35-1b66-435c-a0f8-298bfc4d71d6 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:39.818812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 691/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:41.853940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9291-c8cd-48c5-8a6e-38dd0b898b47 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:41.854393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9291-c8cd-48c5-8a6e-38dd0b898b47 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:41.854581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9291-c8cd-48c5-8a6e-38dd0b898b47 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:41.859896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 695/1386] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:41.861756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4468f0-0063-45ac-9b7f-39ca724a3b7e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:41.862298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4468f0-0063-45ac-9b7f-39ca724a3b7e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:41.862625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4468f0-0063-45ac-9b7f-39ca724a3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:41.907491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-de4468f0-0063-45ac-9b7f-39ca724a3b7e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:41.910897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-de4468f0-0063-45ac-9b7f-39ca724a3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:41.932398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 692/1387] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:24:41.976888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9291-c8cd-48c5-8a6e-38dd0b898b47 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:41.992571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9291-c8cd-48c5-8a6e-38dd0b898b47 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:41.998573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcd60f-c4dc-4ee9-8665-5091b21b23c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:41.999224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd60f-c4dc-4ee9-8665-5091b21b23c9 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:41.999507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd60f-c4dc-4ee9-8665-5091b21b23c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:41.999784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd60f-c4dc-4ee9-8665-5091b21b23c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:42.009309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcd60f-c4dc-4ee9-8665-5091b21b23c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:42.011035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcd60f-c4dc-4ee9-8665-5091b21b23c9 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:42.021153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 696/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:44.563307 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6801-eea7-465a-9f05-654f7537d2f6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:44.563919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6801-eea7-465a-9f05-654f7537d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:44.563919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6801-eea7-465a-9f05-654f7537d2f6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:44.565304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 693/1389] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:44.571043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635b498-5675-41f9-8346-2a753c64347c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:44.571602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635b498-5675-41f9-8346-2a753c64347c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:44.571602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635b498-5675-41f9-8346-2a753c64347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:44.594626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b635b498-5675-41f9-8346-2a753c64347c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:44.596033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b635b498-5675-41f9-8346-2a753c64347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:44.606710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 697/1390] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:44.656309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c6801-eea7-465a-9f05-654f7537d2f6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:44.675781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c6801-eea7-465a-9f05-654f7537d2f6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:44.682969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6743-dc37-4d9d-bc3b-aa0de8436317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:44.683664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6743-dc37-4d9d-bc3b-aa0de8436317 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:44.683947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6743-dc37-4d9d-bc3b-aa0de8436317 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:44.684231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6743-dc37-4d9d-bc3b-aa0de8436317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:44.694139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6743-dc37-4d9d-bc3b-aa0de8436317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:44.695862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda6743-dc37-4d9d-bc3b-aa0de8436317 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:44.708586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 694/1391] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:24:46.847175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c842f-ee19-4795-992e-a5d81fc6535e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:46.847758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c842f-ee19-4795-992e-a5d81fc6535e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:46.847945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c842f-ee19-4795-992e-a5d81fc6535e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:46.849819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 698/1392] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:46.855702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32393e1-cb3e-4e6e-b381-98e887eaf286 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:46.856346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32393e1-cb3e-4e6e-b381-98e887eaf286 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:46.856346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32393e1-cb3e-4e6e-b381-98e887eaf286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:46.875490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b32393e1-cb3e-4e6e-b381-98e887eaf286 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:46.877231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b32393e1-cb3e-4e6e-b381-98e887eaf286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:46.889455 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 695/1393] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:46.935697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c842f-ee19-4795-992e-a5d81fc6535e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:46.952283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c842f-ee19-4795-992e-a5d81fc6535e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:46.958506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f1c47-9143-429e-8947-1ad0ce166222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:46.959166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f1c47-9143-429e-8947-1ad0ce166222 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:46.959462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f1c47-9143-429e-8947-1ad0ce166222 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:46.959742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f1c47-9143-429e-8947-1ad0ce166222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:46.969497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f1c47-9143-429e-8947-1ad0ce166222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:46.971139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f1c47-9143-429e-8947-1ad0ce166222 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:46.981906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 699/1394] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:49.226679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dcec1-afc0-4608-995f-bd9069bb5790 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:49.227389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dcec1-afc0-4608-995f-bd9069bb5790 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:49.227389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3dcec1-afc0-4608-995f-bd9069bb5790 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:49.228633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 696/1395] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:49.233966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802d31-28f2-4866-84fb-18d777580e73 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:49.234505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802d31-28f2-4866-84fb-18d777580e73 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:49.234505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c802d31-28f2-4866-84fb-18d777580e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:49.253578 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8c802d31-28f2-4866-84fb-18d777580e73 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:49.254789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c802d31-28f2-4866-84fb-18d777580e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:49.263718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 700/1396] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:49.309141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3dcec1-afc0-4608-995f-bd9069bb5790 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:49.323662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3dcec1-afc0-4608-995f-bd9069bb5790 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:49.329568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f986299-1f29-4687-a26a-c65c4ac99d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:49.330209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f986299-1f29-4687-a26a-c65c4ac99d66 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:49.330482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f986299-1f29-4687-a26a-c65c4ac99d66 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:49.330753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f986299-1f29-4687-a26a-c65c4ac99d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:49.339563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f986299-1f29-4687-a26a-c65c4ac99d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:49.341170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f986299-1f29-4687-a26a-c65c4ac99d66 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:49.350992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 697/1397] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:49.797055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874af24b-0773-4a7e-b062-53c5b9dbf90b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:49.797333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874af24b-0773-4a7e-b062-53c5b9dbf90b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:49.797590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874af24b-0773-4a7e-b062-53c5b9dbf90b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:49.799184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 701/1398] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:49.805017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c78cf-3967-4732-923e-bda47fcd2882 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:49.805408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c78cf-3967-4732-923e-bda47fcd2882 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:49.805769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c78cf-3967-4732-923e-bda47fcd2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:49.824862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8d2c78cf-3967-4732-923e-bda47fcd2882 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:49.826060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8d2c78cf-3967-4732-923e-bda47fcd2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:49.835467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 698/1399] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:49.891799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aafb03-32f7-4ac9-8f7f-ada5a686f939 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:49.892054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aafb03-32f7-4ac9-8f7f-ada5a686f939 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:49.892610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aafb03-32f7-4ac9-8f7f-ada5a686f939 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:49.894091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 702/1400] 10.222.0.66 () {54 vars in 962 bytes} [Thu Jun 23 11:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:24:49.899304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6029-df68-40fc-82aa-cf76f4249bb3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:49.899574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6029-df68-40fc-82aa-cf76f4249bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:49.899910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f6029-df68-40fc-82aa-cf76f4249bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:49.951081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-463f6029-df68-40fc-82aa-cf76f4249bb3 None None] MFA Rules not processed for user `91b91c561e944aa5924e3e08bbdf63fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:49.952359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-463f6029-df68-40fc-82aa-cf76f4249bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:50.013656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 699/1401] 10.222.0.66 () {58 vars in 1059 bytes} [Thu Jun 23 11:24:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:50.021768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aafb03-32f7-4ac9-8f7f-ada5a686f939 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:50.033633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aafb03-32f7-4ac9-8f7f-ada5a686f939 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:50.037365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbcc0e-b183-4d9b-a701-316d61b97f83 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:50.037998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcc0e-b183-4d9b-a701-316d61b97f83 service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:50.038279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcc0e-b183-4d9b-a701-316d61b97f83 service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:50.038549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbcc0e-b183-4d9b-a701-316d61b97f83 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:50.052143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbcc0e-b183-4d9b-a701-316d61b97f83 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:50.053552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbcc0e-b183-4d9b-a701-316d61b97f83 service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:50.063672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 703/1402] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:24:50.777158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ac12-374d-4636-94b7-8167ce042936 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:50.777651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ac12-374d-4636-94b7-8167ce042936 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:50.777744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ac12-374d-4636-94b7-8167ce042936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:50.826809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b844ac12-374d-4636-94b7-8167ce042936 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:50.828009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b844ac12-374d-4636-94b7-8167ce042936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:50.869353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:24:50.894663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 700/1403] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:24:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:50.940598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac46d3-17fc-4c02-b750-9731feb29686 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:50.941311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac46d3-17fc-4c02-b750-9731feb29686 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:50.941594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac46d3-17fc-4c02-b750-9731feb29686 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:50.942992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 704/1404] 10.222.0.66 () {54 vars in 942 bytes} [Thu Jun 23 11:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:50.949775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28fd5-c68f-4865-a198-6e754bb04ead None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:50.950059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28fd5-c68f-4865-a198-6e754bb04ead None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:50.950321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a28fd5-c68f-4865-a198-6e754bb04ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:51.002200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c5a28fd5-c68f-4865-a198-6e754bb04ead None None] MFA Rules not processed for user `954ff9ef0bd54012af73a0b901a7893b`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:51.003356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c5a28fd5-c68f-4865-a198-6e754bb04ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:51.079595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 701/1405] 10.222.0.66 () {58 vars in 1039 bytes} [Thu Jun 23 11:24:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:51.089254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac46d3-17fc-4c02-b750-9731feb29686 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:51.097007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=61 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:24:51.104606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac46d3-17fc-4c02-b750-9731feb29686 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:51.109842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ad6fc-ab04-4b85-a744-0093832b1b62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:51.110489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ad6fc-ab04-4b85-a744-0093832b1b62 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:51.110770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ad6fc-ab04-4b85-a744-0093832b1b62 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:51.111046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ad6fc-ab04-4b85-a744-0093832b1b62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:51.119772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ad6fc-ab04-4b85-a744-0093832b1b62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:51.121388 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ad6fc-ab04-4b85-a744-0093832b1b62 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:51.129619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 705/1406] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:24:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:24:51.440325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afe7a-2d32-48e0-b9ca-d213ff161bac None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:51.440613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afe7a-2d32-48e0-b9ca-d213ff161bac None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:51.440913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afe7a-2d32-48e0-b9ca-d213ff161bac None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:51.442321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 702/1407] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:24:51.447557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2bf3e-1f83-488d-894e-b36ad003645d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:51.447841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2bf3e-1f83-488d-894e-b36ad003645d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:51.448116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2bf3e-1f83-488d-894e-b36ad003645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:51.470822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8de2bf3e-1f83-488d-894e-b36ad003645d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:24:51.470822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8de2bf3e-1f83-488d-894e-b36ad003645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:24:51.478595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 706/1408] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:24:51.522759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871afe7a-2d32-48e0-b9ca-d213ff161bac None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:24:51.538879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871afe7a-2d32-48e0-b9ca-d213ff161bac None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:24:51.552641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ce7fa-47b0-41ba-9e34-6f901a512dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:24:51.553377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce7fa-47b0-41ba-9e34-6f901a512dc8 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:24:51.553658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce7fa-47b0-41ba-9e34-6f901a512dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:24:51.553934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ce7fa-47b0-41ba-9e34-6f901a512dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:24:51.564094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ce7fa-47b0-41ba-9e34-6f901a512dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:24:51.565971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ce7fa-47b0-41ba-9e34-6f901a512dc8 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:24:51.579906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 703/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:01.463567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:25:01.577581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=59 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:25:13.101569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfdf0f-bb2b-4939-8d83-d89bf0401603 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:13.102212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfdf0f-bb2b-4939-8d83-d89bf0401603 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:13.102212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfdf0f-bb2b-4939-8d83-d89bf0401603 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:13.103534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 707/1410] 10.222.0.66 () {54 vars in 918 bytes} [Thu Jun 23 11:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:13.110892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c217-d22d-4023-9bcd-1525bbb01b13 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:13.111325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c217-d22d-4023-9bcd-1525bbb01b13 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:13.111446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c217-d22d-4023-9bcd-1525bbb01b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:13.131212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5308c217-d22d-4023-9bcd-1525bbb01b13 None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:13.132439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5308c217-d22d-4023-9bcd-1525bbb01b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:13.146008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 704/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Jun 23 11:25:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:13.160701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b2b0-998b-4df0-ac92-05ed2334206d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:13.161021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b2b0-998b-4df0-ac92-05ed2334206d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:13.161296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b2b0-998b-4df0-ac92-05ed2334206d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:13.162702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 708/1412] 10.222.0.66 () {54 vars in 918 bytes} [Thu Jun 23 11:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:13.167609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1bb36-7270-4cfe-aad7-93e5f2ef91cc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:13.167896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1bb36-7270-4cfe-aad7-93e5f2ef91cc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:13.168194 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1bb36-7270-4cfe-aad7-93e5f2ef91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:13.187451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1de1bb36-7270-4cfe-aad7-93e5f2ef91cc None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:13.188652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1de1bb36-7270-4cfe-aad7-93e5f2ef91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:13.200610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 705/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Thu Jun 23 11:25:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:15.716149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9747-1e71-4bcd-a5fa-bec146ebde0f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:15.716752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9747-1e71-4bcd-a5fa-bec146ebde0f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:15.716752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9747-1e71-4bcd-a5fa-bec146ebde0f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:15.718084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:25:15.724585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e49c-df6a-4f5a-bd60-be74ee62d021 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:15.725374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e49c-df6a-4f5a-bd60-be74ee62d021 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:15.725527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e49c-df6a-4f5a-bd60-be74ee62d021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:15.751013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5ae6e49c-df6a-4f5a-bd60-be74ee62d021 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:15.752223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5ae6e49c-df6a-4f5a-bd60-be74ee62d021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:15.761138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:15.810757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca9747-1e71-4bcd-a5fa-bec146ebde0f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:15.826332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca9747-1e71-4bcd-a5fa-bec146ebde0f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:15.831856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a35eec-3604-40c1-b611-5e62ace68d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:15.832494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35eec-3604-40c1-b611-5e62ace68d34 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:15.832813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35eec-3604-40c1-b611-5e62ace68d34 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:15.833081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a35eec-3604-40c1-b611-5e62ace68d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:15.841537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35eec-3604-40c1-b611-5e62ace68d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:15.843122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a35eec-3604-40c1-b611-5e62ace68d34 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:15.852662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 710/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:16.755654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff40d-c7ed-4e32-b209-0b034ad918c1 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:16.756447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff40d-c7ed-4e32-b209-0b034ad918c1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:16.756447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff40d-c7ed-4e32-b209-0b034ad918c1 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:16.758627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:16.765744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f2bb7-af79-4c76-a5a8-6268dfd207dd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:16.766179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f2bb7-af79-4c76-a5a8-6268dfd207dd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:16.766307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f2bb7-af79-4c76-a5a8-6268dfd207dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:16.794994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9e4f2bb7-af79-4c76-a5a8-6268dfd207dd None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:16.796188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9e4f2bb7-af79-4c76-a5a8-6268dfd207dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:16.806193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:16.958149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff40d-c7ed-4e32-b209-0b034ad918c1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:16.976668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff40d-c7ed-4e32-b209-0b034ad918c1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:16.983462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c0666-9638-4ac5-a1de-77bd5d7f29ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:16.984101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0666-9638-4ac5-a1de-77bd5d7f29ab service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:16.984347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0666-9638-4ac5-a1de-77bd5d7f29ab service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:16.984644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c0666-9638-4ac5-a1de-77bd5d7f29ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:16.993229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0666-9638-4ac5-a1de-77bd5d7f29ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:16.994813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c0666-9638-4ac5-a1de-77bd5d7f29ab service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:17.004579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 708/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:17.910583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c007d-266d-40da-8de4-37b6013e08e7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:17.911477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c007d-266d-40da-8de4-37b6013e08e7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:17.911477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c007d-266d-40da-8de4-37b6013e08e7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:17.913768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:17.922848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2a79-c516-4547-9583-e8743fcb0403 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:17.923315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2a79-c516-4547-9583-e8743fcb0403 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:17.923409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e2a79-c516-4547-9583-e8743fcb0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:17.947514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e87e2a79-c516-4547-9583-e8743fcb0403 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:17.948752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e87e2a79-c516-4547-9583-e8743fcb0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:17.958587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:18.125742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c007d-266d-40da-8de4-37b6013e08e7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:18.141672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c007d-266d-40da-8de4-37b6013e08e7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:18.147449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6a117-1f8d-4edd-b49c-c8d8ba335e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:18.148121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a117-1f8d-4edd-b49c-c8d8ba335e53 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:18.148401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a117-1f8d-4edd-b49c-c8d8ba335e53 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:18.148674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a117-1f8d-4edd-b49c-c8d8ba335e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:18.158060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6a117-1f8d-4edd-b49c-c8d8ba335e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:18.159657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6a117-1f8d-4edd-b49c-c8d8ba335e53 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:18.169575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 713/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:19.028772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cb07e-df82-4b57-bd29-dfd5a825a8f6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:19.029349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cb07e-df82-4b57-bd29-dfd5a825a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:19.029349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cb07e-df82-4b57-bd29-dfd5a825a8f6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:19.030743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:19.037705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8f949-f8b4-45f2-a377-5d883581d1ab None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:19.038135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8f949-f8b4-45f2-a377-5d883581d1ab None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:19.038247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8f949-f8b4-45f2-a377-5d883581d1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:19.062086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-72e8f949-f8b4-45f2-a377-5d883581d1ab None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:19.063317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-72e8f949-f8b4-45f2-a377-5d883581d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:19.072003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:19.225683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cb07e-df82-4b57-bd29-dfd5a825a8f6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:19.242718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cb07e-df82-4b57-bd29-dfd5a825a8f6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:19.249533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd0059-1a73-4105-b423-722dc105152d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:19.250179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0059-1a73-4105-b423-722dc105152d service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:19.250456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0059-1a73-4105-b423-722dc105152d service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:19.250732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd0059-1a73-4105-b423-722dc105152d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:19.259139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd0059-1a73-4105-b423-722dc105152d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:19.260772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd0059-1a73-4105-b423-722dc105152d service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:19.270315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 711/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:20.137884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591d75-86b9-48bf-b8e7-2dedcd20e18e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:20.138433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591d75-86b9-48bf-b8e7-2dedcd20e18e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:20.138433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b591d75-86b9-48bf-b8e7-2dedcd20e18e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:20.139822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:20.146157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf227d-b6ce-4353-8cbe-e28dd21727a9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:20.146925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf227d-b6ce-4353-8cbe-e28dd21727a9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:20.147098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf227d-b6ce-4353-8cbe-e28dd21727a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:20.169691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cbdf227d-b6ce-4353-8cbe-e28dd21727a9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:20.170910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cbdf227d-b6ce-4353-8cbe-e28dd21727a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:20.181350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:20.333270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b591d75-86b9-48bf-b8e7-2dedcd20e18e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:20.357707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b591d75-86b9-48bf-b8e7-2dedcd20e18e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:20.364368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2bab1-880c-4161-8855-e5fbe5a187a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:20.365013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2bab1-880c-4161-8855-e5fbe5a187a3 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:20.365286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2bab1-880c-4161-8855-e5fbe5a187a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:20.365553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2bab1-880c-4161-8855-e5fbe5a187a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:20.374388 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2bab1-880c-4161-8855-e5fbe5a187a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:20.375982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2bab1-880c-4161-8855-e5fbe5a187a3 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:20.385553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 716/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:21.211684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9685aa-30cd-4639-ac91-0ecccd3c8912 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:21.212251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9685aa-30cd-4639-ac91-0ecccd3c8912 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:21.212251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9685aa-30cd-4639-ac91-0ecccd3c8912 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:21.213648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:21.219785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792ac3-5068-42b9-bf01-2bcb2d1b6c7a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:21.220224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792ac3-5068-42b9-bf01-2bcb2d1b6c7a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:21.220343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792ac3-5068-42b9-bf01-2bcb2d1b6c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:21.242939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cc792ac3-5068-42b9-bf01-2bcb2d1b6c7a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:21.244148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cc792ac3-5068-42b9-bf01-2bcb2d1b6c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:21.255904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:21.406050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9685aa-30cd-4639-ac91-0ecccd3c8912 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:21.426586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9685aa-30cd-4639-ac91-0ecccd3c8912 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:21.433295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7d228-7e55-427c-a967-a3469e8797bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:21.433799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d228-7e55-427c-a967-a3469e8797bb service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:21.434075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d228-7e55-427c-a967-a3469e8797bb service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:21.434342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7d228-7e55-427c-a967-a3469e8797bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:21.442841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d228-7e55-427c-a967-a3469e8797bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:21.444415 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7d228-7e55-427c-a967-a3469e8797bb service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:21.454281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 714/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:22.263769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15574d5e-8290-4305-9f7e-4af8323df005 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:22.264340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15574d5e-8290-4305-9f7e-4af8323df005 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:22.264340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15574d5e-8290-4305-9f7e-4af8323df005 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:22.265734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:22.271817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69d09-66bf-4a3a-a8f0-be48a9a759fa None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:22.272298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69d09-66bf-4a3a-a8f0-be48a9a759fa None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:22.272400 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69d09-66bf-4a3a-a8f0-be48a9a759fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:22.294260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c4d69d09-66bf-4a3a-a8f0-be48a9a759fa None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:22.295495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c4d69d09-66bf-4a3a-a8f0-be48a9a759fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:22.305293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:22.457293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15574d5e-8290-4305-9f7e-4af8323df005 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:22.476355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15574d5e-8290-4305-9f7e-4af8323df005 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:22.483054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525775cf-4be7-4452-94e0-27c40d7690d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:22.483692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525775cf-4be7-4452-94e0-27c40d7690d8 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:22.484030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525775cf-4be7-4452-94e0-27c40d7690d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:22.484309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525775cf-4be7-4452-94e0-27c40d7690d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:22.492471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525775cf-4be7-4452-94e0-27c40d7690d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:22.494087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525775cf-4be7-4452-94e0-27c40d7690d8 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:22.503511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 719/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:23.313877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016019-14bc-4e89-9ee4-f11e69e5ed3a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:23.314721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016019-14bc-4e89-9ee4-f11e69e5ed3a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:23.314721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016019-14bc-4e89-9ee4-f11e69e5ed3a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:23.316870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:23.324910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812522d6-6443-41d5-891b-c1471b1d13a1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:23.325343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812522d6-6443-41d5-891b-c1471b1d13a1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:23.325448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812522d6-6443-41d5-891b-c1471b1d13a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:23.344707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-812522d6-6443-41d5-891b-c1471b1d13a1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:23.345948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-812522d6-6443-41d5-891b-c1471b1d13a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:23.354733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:23.509543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016019-14bc-4e89-9ee4-f11e69e5ed3a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:23.526106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016019-14bc-4e89-9ee4-f11e69e5ed3a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:23.532129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06ed8f-1547-4479-9bd6-b673d25c190f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:23.532783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06ed8f-1547-4479-9bd6-b673d25c190f service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:23.533071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06ed8f-1547-4479-9bd6-b673d25c190f service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:23.533351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06ed8f-1547-4479-9bd6-b673d25c190f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:23.541669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06ed8f-1547-4479-9bd6-b673d25c190f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:23.543381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06ed8f-1547-4479-9bd6-b673d25c190f service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:23.553380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 717/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:24.358870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943cd39-5208-48b0-a0ea-8ea5894f15bd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:24.359737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943cd39-5208-48b0-a0ea-8ea5894f15bd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:24.359737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943cd39-5208-48b0-a0ea-8ea5894f15bd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:24.361830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:24.370146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0f9d-da48-47e7-b6f9-2340c020662e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:24.371108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0f9d-da48-47e7-b6f9-2340c020662e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:24.371397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0f9d-da48-47e7-b6f9-2340c020662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:24.395429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0a1c0f9d-da48-47e7-b6f9-2340c020662e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:24.396641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0a1c0f9d-da48-47e7-b6f9-2340c020662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:24.405494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:24.557781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943cd39-5208-48b0-a0ea-8ea5894f15bd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:24.575759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943cd39-5208-48b0-a0ea-8ea5894f15bd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:24.582191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda7b3b-d8b3-48ae-98c5-cd60aa3be850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:24.582825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7b3b-d8b3-48ae-98c5-cd60aa3be850 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:24.583106 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7b3b-d8b3-48ae-98c5-cd60aa3be850 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:24.583382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda7b3b-d8b3-48ae-98c5-cd60aa3be850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:24.592283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda7b3b-d8b3-48ae-98c5-cd60aa3be850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:24.593948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda7b3b-d8b3-48ae-98c5-cd60aa3be850 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:24.604223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 722/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:26.532269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9cdf-2f9c-48bd-95d0-fd29646f6bcb None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:26.533281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9cdf-2f9c-48bd-95d0-fd29646f6bcb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:26.533281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d9cdf-2f9c-48bd-95d0-fd29646f6bcb None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:26.535364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:26.543889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a04fc-db04-421a-8f0a-17fb970a264f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:26.544315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a04fc-db04-421a-8f0a-17fb970a264f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:26.544417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a04fc-db04-421a-8f0a-17fb970a264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:26.563568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ab8a04fc-db04-421a-8f0a-17fb970a264f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:26.564793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab8a04fc-db04-421a-8f0a-17fb970a264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:26.573039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:26.612132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9cdf-2f9c-48bd-95d0-fd29646f6bcb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:26.630705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d9cdf-2f9c-48bd-95d0-fd29646f6bcb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:26.637541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2054b-420e-4f8a-a67a-5167049b184d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:26.638183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2054b-420e-4f8a-a67a-5167049b184d service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:26.638470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2054b-420e-4f8a-a67a-5167049b184d service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:26.638741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2054b-420e-4f8a-a67a-5167049b184d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:26.648546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2054b-420e-4f8a-a67a-5167049b184d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:26.650034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2054b-420e-4f8a-a67a-5167049b184d service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:26.660195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 720/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:28.951487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a97d-0642-463c-9a60-3e81fc135801 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:28.952079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a97d-0642-463c-9a60-3e81fc135801 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:28.952079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6a97d-0642-463c-9a60-3e81fc135801 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:28.953478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:28.959817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d39d7-db69-4723-b6f3-107fe69c1b7e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:28.960253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d39d7-db69-4723-b6f3-107fe69c1b7e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:28.960368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d39d7-db69-4723-b6f3-107fe69c1b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:28.980269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b79d39d7-db69-4723-b6f3-107fe69c1b7e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:28.981494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b79d39d7-db69-4723-b6f3-107fe69c1b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:28.990807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:29.028671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6a97d-0642-463c-9a60-3e81fc135801 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:29.040571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6a97d-0642-463c-9a60-3e81fc135801 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:29.044930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77bb62-7957-4a0b-ab19-9d9c2e690db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:29.045586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77bb62-7957-4a0b-ab19-9d9c2e690db5 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:29.045865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77bb62-7957-4a0b-ab19-9d9c2e690db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:29.046130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77bb62-7957-4a0b-ab19-9d9c2e690db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:29.057032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77bb62-7957-4a0b-ab19-9d9c2e690db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:29.058740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77bb62-7957-4a0b-ab19-9d9c2e690db5 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:29.068753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 725/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:25:31.429702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f9ee-67a7-43b1-b9aa-ca2a492638ab None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:31.430316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f9ee-67a7-43b1-b9aa-ca2a492638ab None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:31.430316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4f9ee-67a7-43b1-b9aa-ca2a492638ab None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:31.431679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:31.438512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c722-f73f-472c-875e-317e59668789 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:31.439206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c722-f73f-472c-875e-317e59668789 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:31.439310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7c722-f73f-472c-875e-317e59668789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:31.467071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ded7c722-f73f-472c-875e-317e59668789 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:31.468329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ded7c722-f73f-472c-875e-317e59668789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:31.477897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:31.520224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4f9ee-67a7-43b1-b9aa-ca2a492638ab None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:31.534470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4f9ee-67a7-43b1-b9aa-ca2a492638ab None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:31.538810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245e1fc-5015-4dec-84f4-76175ab6c048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:31.539450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245e1fc-5015-4dec-84f4-76175ab6c048 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:31.539729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245e1fc-5015-4dec-84f4-76175ab6c048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:31.539999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245e1fc-5015-4dec-84f4-76175ab6c048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:31.550262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245e1fc-5015-4dec-84f4-76175ab6c048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:31.551686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245e1fc-5015-4dec-84f4-76175ab6c048 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:31.561257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 723/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:33.738417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584d07-1edc-4d83-b049-6cce09b1a2a6 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:33.738995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584d07-1edc-4d83-b049-6cce09b1a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:33.738995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584d07-1edc-4d83-b049-6cce09b1a2a6 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:33.741163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:33.747713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0008d-ef9f-4f62-b9fe-e2bd0557ff80 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:33.748455 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0008d-ef9f-4f62-b9fe-e2bd0557ff80 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:33.748632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0008d-ef9f-4f62-b9fe-e2bd0557ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:33.776616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ecd0008d-ef9f-4f62-b9fe-e2bd0557ff80 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:33.778029 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ecd0008d-ef9f-4f62-b9fe-e2bd0557ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:33.786789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:33.826541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584d07-1edc-4d83-b049-6cce09b1a2a6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:33.838643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584d07-1edc-4d83-b049-6cce09b1a2a6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:33.843110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778109a8-80f7-4e25-a659-5cd5955c667e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:33.843756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778109a8-80f7-4e25-a659-5cd5955c667e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:33.844037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778109a8-80f7-4e25-a659-5cd5955c667e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:33.844303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778109a8-80f7-4e25-a659-5cd5955c667e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:33.855590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778109a8-80f7-4e25-a659-5cd5955c667e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:33.857077 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778109a8-80f7-4e25-a659-5cd5955c667e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:33.867576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 728/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:35.984043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ea32-8018-4003-bbb7-8e2997be6db5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:35.984637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ea32-8018-4003-bbb7-8e2997be6db5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:35.984637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ea32-8018-4003-bbb7-8e2997be6db5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:35.986022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:35.992536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149db5-c2c5-476d-a37a-bc4fdacdcb36 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:35.993333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149db5-c2c5-476d-a37a-bc4fdacdcb36 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:35.993582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a149db5-c2c5-476d-a37a-bc4fdacdcb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:36.015334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1a149db5-c2c5-476d-a37a-bc4fdacdcb36 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:36.016567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a149db5-c2c5-476d-a37a-bc4fdacdcb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:36.026238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:36.065145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ea32-8018-4003-bbb7-8e2997be6db5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:36.076506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ea32-8018-4003-bbb7-8e2997be6db5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:36.080442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e648f-a455-49c0-9550-76cadd4ba38c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:36.081111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e648f-a455-49c0-9550-76cadd4ba38c service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:36.081384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e648f-a455-49c0-9550-76cadd4ba38c service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:36.081653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e648f-a455-49c0-9550-76cadd4ba38c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:36.090504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e648f-a455-49c0-9550-76cadd4ba38c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:36.091986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e648f-a455-49c0-9550-76cadd4ba38c service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:36.101378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 726/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:38.223208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4fc1-05df-44e8-a222-3c8c75cc4a3c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:38.223774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4fc1-05df-44e8-a222-3c8c75cc4a3c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:38.223774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4fc1-05df-44e8-a222-3c8c75cc4a3c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:38.225173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:38.231684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c04c73-11d2-4f55-83af-40c9f9bd6c5a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:38.232162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c04c73-11d2-4f55-83af-40c9f9bd6c5a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:38.232257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c04c73-11d2-4f55-83af-40c9f9bd6c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:38.259422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-39c04c73-11d2-4f55-83af-40c9f9bd6c5a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:38.260672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-39c04c73-11d2-4f55-83af-40c9f9bd6c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:38.269758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:38.321052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4fc1-05df-44e8-a222-3c8c75cc4a3c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:38.335802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c4fc1-05df-44e8-a222-3c8c75cc4a3c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:38.339843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e74fa-3f6c-415f-8adc-b299fe09ad17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:38.340585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e74fa-3f6c-415f-8adc-b299fe09ad17 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:38.340892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e74fa-3f6c-415f-8adc-b299fe09ad17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:38.341165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e74fa-3f6c-415f-8adc-b299fe09ad17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:38.350975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e74fa-3f6c-415f-8adc-b299fe09ad17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:38.352394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e74fa-3f6c-415f-8adc-b299fe09ad17 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:38.362187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 731/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:40.456846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224de1c8-c5f6-4c6d-9dd5-c5919ad6c532 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:40.457732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224de1c8-c5f6-4c6d-9dd5-c5919ad6c532 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:40.457732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224de1c8-c5f6-4c6d-9dd5-c5919ad6c532 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:40.460244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:40.466466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a079ef0-358b-4a96-8bf8-c10d2b7da544 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:40.466941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a079ef0-358b-4a96-8bf8-c10d2b7da544 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:40.467061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a079ef0-358b-4a96-8bf8-c10d2b7da544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:40.486111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7a079ef0-358b-4a96-8bf8-c10d2b7da544 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:40.487325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7a079ef0-358b-4a96-8bf8-c10d2b7da544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:40.496444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:40.538256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224de1c8-c5f6-4c6d-9dd5-c5919ad6c532 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:40.554144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224de1c8-c5f6-4c6d-9dd5-c5919ad6c532 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:40.558262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860b5c-d75c-41a1-9262-2d6166889daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:40.558900 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860b5c-d75c-41a1-9262-2d6166889daf service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:40.559181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860b5c-d75c-41a1-9262-2d6166889daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:40.559450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860b5c-d75c-41a1-9262-2d6166889daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:40.569676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860b5c-d75c-41a1-9262-2d6166889daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:40.571140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860b5c-d75c-41a1-9262-2d6166889daf service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:40.581656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 729/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:42.757951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962476a6-5be8-4d7b-a7a0-c7f22b99b6d1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:42.758581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962476a6-5be8-4d7b-a7a0-c7f22b99b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:42.758581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962476a6-5be8-4d7b-a7a0-c7f22b99b6d1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:42.759888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:42.766096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338990-1625-46fc-9846-04aa279a6872 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:42.766558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338990-1625-46fc-9846-04aa279a6872 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:42.766651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a338990-1625-46fc-9846-04aa279a6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:42.775390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=79 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:25:42.788387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6a338990-1625-46fc-9846-04aa279a6872 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:42.789646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6a338990-1625-46fc-9846-04aa279a6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:42.799745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:42.837845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962476a6-5be8-4d7b-a7a0-c7f22b99b6d1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:42.843767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=73 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:25:42.850385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962476a6-5be8-4d7b-a7a0-c7f22b99b6d1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:42.855523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ef7ef-dad3-4322-81e3-e89965ff8f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:42.856459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ef7ef-dad3-4322-81e3-e89965ff8f89 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:42.856911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ef7ef-dad3-4322-81e3-e89965ff8f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:42.857292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ef7ef-dad3-4322-81e3-e89965ff8f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:42.867622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ef7ef-dad3-4322-81e3-e89965ff8f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:42.869092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ef7ef-dad3-4322-81e3-e89965ff8f89 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:42.878627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 734/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:25:44.913814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2619c8-e699-4793-823c-abc7d244e90e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:44.914742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2619c8-e699-4793-823c-abc7d244e90e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:44.914742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2619c8-e699-4793-823c-abc7d244e90e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:44.916958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:44.926073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd0d4-6bb9-4b13-9aa0-9f6253380dc5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:44.926501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd0d4-6bb9-4b13-9aa0-9f6253380dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:44.926708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd0d4-6bb9-4b13-9aa0-9f6253380dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:44.949312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-31ccd0d4-6bb9-4b13-9aa0-9f6253380dc5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:44.950559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31ccd0d4-6bb9-4b13-9aa0-9f6253380dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:44.960106 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:25:45.001687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2619c8-e699-4793-823c-abc7d244e90e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:45.017479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2619c8-e699-4793-823c-abc7d244e90e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:45.021395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2906b-e568-42f0-9273-df9f46ac0ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:45.022035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2906b-e568-42f0-9273-df9f46ac0ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:45.022317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2906b-e568-42f0-9273-df9f46ac0ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:45.022598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2906b-e568-42f0-9273-df9f46ac0ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:45.032941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2906b-e568-42f0-9273-df9f46ac0ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:45.034400 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2906b-e568-42f0-9273-df9f46ac0ac0 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:45.044510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 732/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:47.093914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c50269-522b-47e0-bac2-564f22c05790 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:47.094404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c50269-522b-47e0-bac2-564f22c05790 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:47.094494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c50269-522b-47e0-bac2-564f22c05790 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:47.095873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:25:47.101597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9c5c-3ddb-43ab-86b0-55d97d3a1ea4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:47.102033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9c5c-3ddb-43ab-86b0-55d97d3a1ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:47.102143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9c5c-3ddb-43ab-86b0-55d97d3a1ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:47.122818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a8dd9c5c-3ddb-43ab-86b0-55d97d3a1ea4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:25:47.124422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a8dd9c5c-3ddb-43ab-86b0-55d97d3a1ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:25:47.132420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:25:47.172981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c50269-522b-47e0-bac2-564f22c05790 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:25:47.190629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c50269-522b-47e0-bac2-564f22c05790 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:25:47.195132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88d817-3300-425c-92fc-f85c6d949ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:25:47.195773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d817-3300-425c-92fc-f85c6d949ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:25:47.196034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d817-3300-425c-92fc-f85c6d949ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:25:47.196304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88d817-3300-425c-92fc-f85c6d949ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:25:47.205942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88d817-3300-425c-92fc-f85c6d949ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:25:47.207368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88d817-3300-425c-92fc-f85c6d949ce0 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:25:47.216849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 737/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:25:57.116251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=11 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:25:57.212698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=14 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:26:07.147391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d61d32-4455-431a-8445-bf1ff74a8a2f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:07.148260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d61d32-4455-431a-8445-bf1ff74a8a2f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:07.148260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d61d32-4455-431a-8445-bf1ff74a8a2f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:07.150548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 734/1471] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:07.159277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56520-7ce2-4cbf-b062-9694ec2fffa5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:07.159717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56520-7ce2-4cbf-b062-9694ec2fffa5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:07.159886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc56520-7ce2-4cbf-b062-9694ec2fffa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:07.178902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dcc56520-7ce2-4cbf-b062-9694ec2fffa5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:07.180098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dcc56520-7ce2-4cbf-b062-9694ec2fffa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:07.188838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 738/1472] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:26:07.239986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0542-2d97-42bc-a6c4-380fe5226feb None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:07.240344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0542-2d97-42bc-a6c4-380fe5226feb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:07.240707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca0542-2d97-42bc-a6c4-380fe5226feb None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:07.242726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 735/1473] 10.222.0.66 () {54 vars in 962 bytes} [Thu Jun 23 11:26:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:07.247730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcb4c-505e-49aa-a843-3e61bbe256c9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:07.248015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcb4c-505e-49aa-a843-3e61bbe256c9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:07.248304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dcb4c-505e-49aa-a843-3e61bbe256c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:07.267760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-607dcb4c-505e-49aa-a843-3e61bbe256c9 None None] MFA Rules not processed for user `91b91c561e944aa5924e3e08bbdf63fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:07.269003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-607dcb4c-505e-49aa-a843-3e61bbe256c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:07.277172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 739/1474] 10.222.0.66 () {58 vars in 1059 bytes} [Thu Jun 23 11:26:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:26:07.285113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca0542-2d97-42bc-a6c4-380fe5226feb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:26:07.300190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca0542-2d97-42bc-a6c4-380fe5226feb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:26:07.305143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b687-6fea-4b45-aa66-303f9b08cafe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:26:07.305847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b687-6fea-4b45-aa66-303f9b08cafe service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:07.306064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b687-6fea-4b45-aa66-303f9b08cafe service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:07.306318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b687-6fea-4b45-aa66-303f9b08cafe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:07.316755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3b687-6fea-4b45-aa66-303f9b08cafe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:26:07.318122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3b687-6fea-4b45-aa66-303f9b08cafe service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:26:07.327822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 736/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:26:09.446321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cf3b6-8d51-46e0-827c-a594a0306234 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:09.447202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cf3b6-8d51-46e0-827c-a594a0306234 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:09.447202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cf3b6-8d51-46e0-827c-a594a0306234 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:09.449503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 740/1476] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:09.455004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60346-b238-4917-96cb-c28cbae6a073 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:09.455437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60346-b238-4917-96cb-c28cbae6a073 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:09.455538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60346-b238-4917-96cb-c28cbae6a073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:09.474877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ade60346-b238-4917-96cb-c28cbae6a073 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:09.476075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ade60346-b238-4917-96cb-c28cbae6a073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:09.484416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 737/1477] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:26:09.508758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cf3b6-8d51-46e0-827c-a594a0306234 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:26:09.531903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cf3b6-8d51-46e0-827c-a594a0306234 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:26:09.537796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c03bd-650f-432f-aee0-af31bd693031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:26:09.538399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c03bd-650f-432f-aee0-af31bd693031 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:09.538679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c03bd-650f-432f-aee0-af31bd693031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:09.538952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c03bd-650f-432f-aee0-af31bd693031 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:09.539686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c03bd-650f-432f-aee0-af31bd693031 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:26:09.541475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-330c03bd-650f-432f-aee0-af31bd693031 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:26:09.541475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:26:09.541475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:26:09.542603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c03bd-650f-432f-aee0-af31bd693031 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:26:09.563050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 741/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Thu Jun 23 11:26:09 2022] GET /identity/v3/projects => generated 2553 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:26:11.622038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6215b-a3f9-41f8-a626-89176b65ca82 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:11.622646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6215b-a3f9-41f8-a626-89176b65ca82 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:11.622646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6215b-a3f9-41f8-a626-89176b65ca82 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:11.623993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 738/1479] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:11.630388 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f76da-1860-416c-8aaa-4b86a00c184d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:11.630859 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f76da-1860-416c-8aaa-4b86a00c184d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:11.630959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f76da-1860-416c-8aaa-4b86a00c184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:11.658759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c93f76da-1860-416c-8aaa-4b86a00c184d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:11.660015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c93f76da-1860-416c-8aaa-4b86a00c184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:11.669147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 742/1480] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:26:11.716926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6215b-a3f9-41f8-a626-89176b65ca82 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:26:11.731889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6215b-a3f9-41f8-a626-89176b65ca82 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:26:11.737800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8fbfc-5397-476d-9ae0-d38ac7505b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:26:11.738478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8fbfc-5397-476d-9ae0-d38ac7505b22 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:11.738758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8fbfc-5397-476d-9ae0-d38ac7505b22 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:11.739028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8fbfc-5397-476d-9ae0-d38ac7505b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:11.747434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8fbfc-5397-476d-9ae0-d38ac7505b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:26:11.749047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8fbfc-5397-476d-9ae0-d38ac7505b22 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:26:11.759259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 739/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:26:13.959758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39fd8-0812-42fa-a172-1b297cd86b58 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:13.960616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39fd8-0812-42fa-a172-1b297cd86b58 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:13.960616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea39fd8-0812-42fa-a172-1b297cd86b58 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:13.962402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 743/1482] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:26:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:13.971431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe926d19-7928-452d-805e-fd80d110b2c3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:13.971845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe926d19-7928-452d-805e-fd80d110b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:13.971989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe926d19-7928-452d-805e-fd80d110b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:13.990515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fe926d19-7928-452d-805e-fd80d110b2c3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:13.991732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fe926d19-7928-452d-805e-fd80d110b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:14.000090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 740/1483] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:26:14.037668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39fd8-0812-42fa-a172-1b297cd86b58 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:26:14.052789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea39fd8-0812-42fa-a172-1b297cd86b58 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:26:14.057186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee3b8d-9687-4f9e-9240-275978b4e7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:26:14.057842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee3b8d-9687-4f9e-9240-275978b4e7ab service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:14.058123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee3b8d-9687-4f9e-9240-275978b4e7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:14.058735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee3b8d-9687-4f9e-9240-275978b4e7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:14.068767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee3b8d-9687-4f9e-9240-275978b4e7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:26:14.070213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee3b8d-9687-4f9e-9240-275978b4e7ab service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:26:14.079909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 744/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:26:16.155453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953824-63a7-4ee0-9a95-c3778d454d7c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:16.156258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953824-63a7-4ee0-9a95-c3778d454d7c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:16.156401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953824-63a7-4ee0-9a95-c3778d454d7c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:16.158944 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 741/1485] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:26:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:16.167136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae55a-65be-465f-b98e-a7c4a169c99e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:16.167577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae55a-65be-465f-b98e-a7c4a169c99e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:16.167683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae55a-65be-465f-b98e-a7c4a169c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:16.193219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0acae55a-65be-465f-b98e-a7c4a169c99e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:16.194466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0acae55a-65be-465f-b98e-a7c4a169c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:16.204498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 745/1486] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:26:16.247447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82953824-63a7-4ee0-9a95-c3778d454d7c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:26:16.260213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82953824-63a7-4ee0-9a95-c3778d454d7c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:26:16.265140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b02c77-98be-4259-b2c4-d24a29975a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:26:16.266144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b02c77-98be-4259-b2c4-d24a29975a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:16.266626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b02c77-98be-4259-b2c4-d24a29975a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:16.266998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b02c77-98be-4259-b2c4-d24a29975a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:16.283164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b02c77-98be-4259-b2c4-d24a29975a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:26:16.284766 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b02c77-98be-4259-b2c4-d24a29975a60 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:26:16.294728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 742/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:26:18.507829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614cca-fd78-4ff9-aefa-9672ec50af2c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:18.508419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614cca-fd78-4ff9-aefa-9672ec50af2c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:18.508419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e614cca-fd78-4ff9-aefa-9672ec50af2c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:18.510583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 746/1488] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:26:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:18.518587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cac74-5f21-4965-ada5-9de7d8960ff2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:18.519039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cac74-5f21-4965-ada5-9de7d8960ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:18.519152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43cac74-5f21-4965-ada5-9de7d8960ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:18.538999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e43cac74-5f21-4965-ada5-9de7d8960ff2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:18.540186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e43cac74-5f21-4965-ada5-9de7d8960ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:18.548565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 743/1489] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:26:18.590003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e614cca-fd78-4ff9-aefa-9672ec50af2c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:26:18.601537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e614cca-fd78-4ff9-aefa-9672ec50af2c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:26:18.605217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f63d1-42cf-46af-94d2-29d163732796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:26:18.605870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f63d1-42cf-46af-94d2-29d163732796 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:18.606142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f63d1-42cf-46af-94d2-29d163732796 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:18.606409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f63d1-42cf-46af-94d2-29d163732796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:18.617139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f63d1-42cf-46af-94d2-29d163732796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:26:18.618567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f63d1-42cf-46af-94d2-29d163732796 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:26:18.628356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 747/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:26:20.950255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936f8e-2402-4662-ad83-90e1afe04f3d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:20.950868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936f8e-2402-4662-ad83-90e1afe04f3d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:20.950868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29936f8e-2402-4662-ad83-90e1afe04f3d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:20.952206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 744/1491] 10.222.0.66 () {54 vars in 926 bytes} [Thu Jun 23 11:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:26:20.957883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d203f1-e86e-45c2-a2a3-95bd4637a2d2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:20.958344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d203f1-e86e-45c2-a2a3-95bd4637a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:20.958458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d203f1-e86e-45c2-a2a3-95bd4637a2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:20.978158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c9d203f1-e86e-45c2-a2a3-95bd4637a2d2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:26:20.979386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c9d203f1-e86e-45c2-a2a3-95bd4637a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:26:20.989350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 748/1492] 10.222.0.66 () {58 vars in 1023 bytes} [Thu Jun 23 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:26:21.036249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29936f8e-2402-4662-ad83-90e1afe04f3d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:26:21.054316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29936f8e-2402-4662-ad83-90e1afe04f3d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:26:21.059045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf8da8-1440-4f3f-bfc8-e164e92e3a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:26:21.059706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf8da8-1440-4f3f-bfc8-e164e92e3a7f service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:26:21.059988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf8da8-1440-4f3f-bfc8-e164e92e3a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:26:21.060289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf8da8-1440-4f3f-bfc8-e164e92e3a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:26:21.070805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf8da8-1440-4f3f-bfc8-e164e92e3a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:26:21.072251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf8da8-1440-4f3f-bfc8-e164e92e3a7f service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:26:21.082427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 745/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:26:30.972822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=33 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:26:31.077724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=33 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:27:53.849974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4379-d451-4c1f-85bf-51753665f394 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:53.850629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4379-d451-4c1f-85bf-51753665f394 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:53.850629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4379-d451-4c1f-85bf-51753665f394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:53.871243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-61eb4379-d451-4c1f-85bf-51753665f394 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:27:53.872455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-61eb4379-d451-4c1f-85bf-51753665f394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:27:53.881646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 749/1494] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:27:53.891259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b3b12-37de-4f6b-9f4e-e20429379311 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:53.891783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b3b12-37de-4f6b-9f4e-e20429379311 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:53.891783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b3b12-37de-4f6b-9f4e-e20429379311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:53.910303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-437b3b12-37de-4f6b-9f4e-e20429379311 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:27:53.911493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-437b3b12-37de-4f6b-9f4e-e20429379311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:27:53.920202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 746/1495] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:27:53.925005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb4379-d451-4c1f-85bf-51753665f394 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:53.936100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb4379-d451-4c1f-85bf-51753665f394 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:53.941712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:53.942369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:53.942650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:53.942922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:53.943680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:27:53.943983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:53.945381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:53.945381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:27:53.945381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:27:53.946265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:53.959094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 750/1496] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:27:53.967827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b3b12-37de-4f6b-9f4e-e20429379311 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:53.977529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b3b12-37de-4f6b-9f4e-e20429379311 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:53.982506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:53.983144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:53.983425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:53.983700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:53.984391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:53.986255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:53.986255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: warnings.warn(msg) Jun 23 11:27:53.986255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: Jun 23 11:27:53.987429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:54.027207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 747/1497] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:27:53 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:27:54.033327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:54.044227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3c80b-488f-4e71-918f-45fb0e6f69e3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:54.109754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:54.110354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.110634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.110902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.111598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:54.112637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:54.112637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:27:54.112637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:27:54.113904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:54.144348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 751/1498] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:27:54 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:27:54.149657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:54.160921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10099d3d-9ac8-42f0-9b1d-7efaf1eea81a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:54.166577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:54.167265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.167637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.167911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.168667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:54.169713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:54.169713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: warnings.warn(msg) Jun 23 11:27:54.169713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: Jun 23 11:27:54.170595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:54.185358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 748/1499] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:27:54.189593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:54.202785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f149b81-7fa0-469c-aabd-2b694a2ca1bf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:54.211159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23ef2b-9038-4006-9b4d-8ebb7d769f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:54.212132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ef2b-9038-4006-9b4d-8ebb7d769f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.212511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ef2b-9038-4006-9b4d-8ebb7d769f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.212876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23ef2b-9038-4006-9b4d-8ebb7d769f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.213908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ef2b-9038-4006-9b4d-8ebb7d769f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:54.215491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-7e23ef2b-9038-4006-9b4d-8ebb7d769f35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:54.215491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:27:54.215491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:27:54.216767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23ef2b-9038-4006-9b4d-8ebb7d769f35 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:54.233987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 752/1500] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:27:54.238308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:54.248996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5c52-a541-4b02-b46c-ddbb80cf8c0e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:54.254800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c91d34-41f9-4530-a73b-88e8e578ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:54.255679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91d34-41f9-4530-a73b-88e8e578ef93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.255957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91d34-41f9-4530-a73b-88e8e578ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.256231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c91d34-41f9-4530-a73b-88e8e578ef93 admin admin] PATH_INFO: `/v3/projects/17a922972e744fa9b240223f93cedab7/users/345080571171462597cf00fdc44c917f/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.272252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c91d34-41f9-4530-a73b-88e8e578ef93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a922972e744fa9b240223f93cedab7, user_id=345080571171462597cf00fdc44c917f, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:54.273404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-a3c91d34-41f9-4530-a73b-88e8e578ef93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:54.273404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: warnings.warn(msg) Jun 23 11:27:54.273404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: Jun 23 11:27:54.275397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c91d34-41f9-4530-a73b-88e8e578ef93 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:54.291913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 749/1501] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:27:54 2022] PUT /identity/v3/projects/17a922972e744fa9b240223f93cedab7/users/345080571171462597cf00fdc44c917f/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:27:54.303740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce599f3-1550-4e75-92c3-2627ffe96875 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.304439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce599f3-1550-4e75-92c3-2627ffe96875 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.304439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce599f3-1550-4e75-92c3-2627ffe96875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.333352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7ce599f3-1550-4e75-92c3-2627ffe96875 None None] MFA Rules not processed for user `345080571171462597cf00fdc44c917f`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:27:54.334564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7ce599f3-1550-4e75-92c3-2627ffe96875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:27:54.402760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 753/1502] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:27:54.416373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987a3f-b2ec-491d-9727-a4853fa938b0 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.416658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987a3f-b2ec-491d-9727-a4853fa938b0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.416963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a987a3f-b2ec-491d-9727-a4853fa938b0 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.418322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 750/1503] 10.222.0.66 () {54 vars in 963 bytes} [Thu Jun 23 11:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:27:54.423460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce1258-539e-465f-8974-cd112feb9518 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.423746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce1258-539e-465f-8974-cd112feb9518 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.424020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce1258-539e-465f-8974-cd112feb9518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.444066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-12ce1258-539e-465f-8974-cd112feb9518 None None] MFA Rules not processed for user `ab171a27a8d043869eddc76d2befe09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:27:54.445728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-12ce1258-539e-465f-8974-cd112feb9518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:27:54.498671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:27:54.508163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 754/1504] 10.222.0.66 () {58 vars in 1060 bytes} [Thu Jun 23 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:27:54.516153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a987a3f-b2ec-491d-9727-a4853fa938b0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:54.527531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a987a3f-b2ec-491d-9727-a4853fa938b0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:54.531208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:54.531825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.532109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.532391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.541044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:54.542474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:54.551439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 751/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:27:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:27:54.598822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c4b5e-6fdd-4406-a0e9-8ef20ebaff9a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.599112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c4b5e-6fdd-4406-a0e9-8ef20ebaff9a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.599394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c4b5e-6fdd-4406-a0e9-8ef20ebaff9a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.600709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 755/1506] 10.222.0.66 () {52 vars in 829 bytes} [Thu Jun 23 11:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:27:54.605009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:54.671686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cd742-259f-4bec-a150-5849fab1e875 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:54.676380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:54.677394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.677733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.678072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] PATH_INFO: `/v3/users/345080571171462597cf00fdc44c917f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.679958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345080571171462597cf00fdc44c917f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:54.681072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:54.681072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: warnings.warn(msg) Jun 23 11:27:54.681072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: Jun 23 11:27:54.682366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:54.749356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345080571171462597cf00fdc44c917f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:54.761782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345080571171462597cf00fdc44c917f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:54.762565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345080571171462597cf00fdc44c917f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:54.763182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345080571171462597cf00fdc44c917f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:54.781352 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345080571171462597cf00fdc44c917f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:54.785361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:27:54.799391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 752/1507] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:27:54 2022] DELETE /identity/v3/users/345080571171462597cf00fdc44c917f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:27:54.805372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.806794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.807309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.831221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:27:54.832610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:27:54.911617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 756/1508] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:27:54.921554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:54.923125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:27:54.983097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167f975-8d99-421f-897c-d9dca4f55290 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:54.987910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59e1da-afc8-4026-81d3-c7c1a0d3468c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:54.988584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59e1da-afc8-4026-81d3-c7c1a0d3468c service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:54.988901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59e1da-afc8-4026-81d3-c7c1a0d3468c service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:54.989178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59e1da-afc8-4026-81d3-c7c1a0d3468c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:54.999808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59e1da-afc8-4026-81d3-c7c1a0d3468c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:55.001305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59e1da-afc8-4026-81d3-c7c1a0d3468c service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:55.011447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 753/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:27:55.369191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:27:55.370918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:27:55.385031 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea61c80-67f7-4b34-9190-f46e0e0a5b1c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:27:55.390396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:27:55.391280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:27:55.391524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:27:55.391823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] PATH_INFO: `/v3/projects/17a922972e744fa9b240223f93cedab7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:27:55.393061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a922972e744fa9b240223f93cedab7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:27:55.394071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:27:55.394071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:27:55.394071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:27:55.395262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:27:55.456887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a922972e744fa9b240223f93cedab7', 'request_id': 'req-dcc7dca6-b151-4fea-8353-b4faa60eebe3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:55.471344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a922972e744fa9b240223f93cedab7', 'request_id': 'req-dcc7dca6-b151-4fea-8353-b4faa60eebe3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:55.478449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a922972e744fa9b240223f93cedab7', 'request_id': 'req-dcc7dca6-b151-4fea-8353-b4faa60eebe3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:55.494919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] The token cache is being invalidate because project 17a922972e744fa9b240223f93cedab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:27:55.495220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:55.495904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcc7dca6-b151-4fea-8353-b4faa60eebe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:27:55.497940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 757/1510] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:27:55 2022] DELETE /identity/v3/projects/17a922972e744fa9b240223f93cedab7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:28:05.006925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:28:05.491825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:29:39.529831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879a5d-5b79-4969-a12c-b54b5fd1c8fd None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:39.530487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879a5d-5b79-4969-a12c-b54b5fd1c8fd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:39.530487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879a5d-5b79-4969-a12c-b54b5fd1c8fd None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:39.531842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:29:39.537021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753bf64-659d-49d9-b489-a76518eb1e29 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:39.537488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753bf64-659d-49d9-b489-a76518eb1e29 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:39.537592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753bf64-659d-49d9-b489-a76518eb1e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:39.556765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a753bf64-659d-49d9-b489-a76518eb1e29 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:39.558013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a753bf64-659d-49d9-b489-a76518eb1e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:39.622423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:39.776390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879a5d-5b79-4969-a12c-b54b5fd1c8fd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:29:39.778407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b4879a5d-5b79-4969-a12c-b54b5fd1c8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:39.859277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879a5d-5b79-4969-a12c-b54b5fd1c8fd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:29:39.865842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaceec-f789-4499-b4f1-7cc718e93e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:29:39.866500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaceec-f789-4499-b4f1-7cc718e93e53 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:39.866778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaceec-f789-4499-b4f1-7cc718e93e53 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:39.867046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaceec-f789-4499-b4f1-7cc718e93e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:39.876071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaceec-f789-4499-b4f1-7cc718e93e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:29:39.877695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaaceec-f789-4499-b4f1-7cc718e93e53 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:29:39.887410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 755/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:29:40.711644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e915-fc04-4a66-a5df-d53f29ea4b97 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:40.712308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e915-fc04-4a66-a5df-d53f29ea4b97 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:40.712308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51e915-fc04-4a66-a5df-d53f29ea4b97 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:40.713609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:29:40.718673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b851b-0ea0-4231-aee0-5adc97a00f7e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:40.719259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b851b-0ea0-4231-aee0-5adc97a00f7e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:40.719259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b851b-0ea0-4231-aee0-5adc97a00f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:40.741643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-014b851b-0ea0-4231-aee0-5adc97a00f7e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:40.742856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-014b851b-0ea0-4231-aee0-5adc97a00f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:40.752618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:40.913565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51e915-fc04-4a66-a5df-d53f29ea4b97 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:29:40.930102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51e915-fc04-4a66-a5df-d53f29ea4b97 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:29:40.936280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246d5cf-5755-4b7e-939e-4019a17c0e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:29:40.937016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246d5cf-5755-4b7e-939e-4019a17c0e5f service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:40.937307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246d5cf-5755-4b7e-939e-4019a17c0e5f service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:40.937651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246d5cf-5755-4b7e-939e-4019a17c0e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:40.946466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246d5cf-5755-4b7e-939e-4019a17c0e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:29:40.948076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246d5cf-5755-4b7e-939e-4019a17c0e5f service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:29:40.957805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 760/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:29:41.142413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90336b-b98f-45f1-b71d-192549143611 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:41.142694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90336b-b98f-45f1-b71d-192549143611 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:41.142958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90336b-b98f-45f1-b71d-192549143611 None None] PATH_INFO: `/v3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:41.144331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 757/1517] 10.222.0.33 () {54 vars in 925 bytes} [Thu Jun 23 11:29:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:29:41.151522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1555670-d5d8-483c-af6e-a8e0046e088b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:41.151891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1555670-d5d8-483c-af6e-a8e0046e088b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:41.152220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1555670-d5d8-483c-af6e-a8e0046e088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:41.174364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a1555670-d5d8-483c-af6e-a8e0046e088b None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:41.175584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a1555670-d5d8-483c-af6e-a8e0046e088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:41.241400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 761/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 23 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:45.050255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189f38-4133-4718-b16d-2f89f631f67b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:45.050779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189f38-4133-4718-b16d-2f89f631f67b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:45.050779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b189f38-4133-4718-b16d-2f89f631f67b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:45.052129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 758/1519] 10.222.0.66 () {54 vars in 960 bytes} [Thu Jun 23 11:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:29:45.057701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d0f69-a17c-42bb-a6dc-d3eb0f7eb579 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:45.058168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d0f69-a17c-42bb-a6dc-d3eb0f7eb579 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:45.058376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d0f69-a17c-42bb-a6dc-d3eb0f7eb579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:45.080642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6b9d0f69-a17c-42bb-a6dc-d3eb0f7eb579 None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:45.081905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6b9d0f69-a17c-42bb-a6dc-d3eb0f7eb579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:45.091137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 762/1520] 10.222.0.66 () {58 vars in 1057 bytes} [Thu Jun 23 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:45.099140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189f38-4133-4718-b16d-2f89f631f67b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:29:45.115821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b189f38-4133-4718-b16d-2f89f631f67b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:29:45.121660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b5a7d-86fb-4547-a8f3-a038ed1106c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:29:45.122305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b5a7d-86fb-4547-a8f3-a038ed1106c9 service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:45.122585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b5a7d-86fb-4547-a8f3-a038ed1106c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:45.122859 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b5a7d-86fb-4547-a8f3-a038ed1106c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:45.131427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b5a7d-86fb-4547-a8f3-a038ed1106c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:29:45.133050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b5a7d-86fb-4547-a8f3-a038ed1106c9 service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:29:45.142769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 759/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:29:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:29:52.217800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f187-1d2c-44f7-ae2d-93ce6cf7d409 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:52.218784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f187-1d2c-44f7-ae2d-93ce6cf7d409 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:52.218784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f187-1d2c-44f7-ae2d-93ce6cf7d409 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:52.220953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:29:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:29:52.226397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da793d-b06b-4530-89d3-65e69de48f99 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:52.226853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da793d-b06b-4530-89d3-65e69de48f99 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:52.226963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da793d-b06b-4530-89d3-65e69de48f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:52.246738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-43da793d-b06b-4530-89d3-65e69de48f99 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:52.247993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-43da793d-b06b-4530-89d3-65e69de48f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:52.256773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:52.411709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f187-1d2c-44f7-ae2d-93ce6cf7d409 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:29:52.432687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f187-1d2c-44f7-ae2d-93ce6cf7d409 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:29:52.441566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e1256-c45e-49c8-a224-2036a0e4f4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:29:52.442602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1256-c45e-49c8-a224-2036a0e4f4b9 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:52.442972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1256-c45e-49c8-a224-2036a0e4f4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:52.443330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e1256-c45e-49c8-a224-2036a0e4f4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:52.456589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e1256-c45e-49c8-a224-2036a0e4f4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:29:52.458951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e1256-c45e-49c8-a224-2036a0e4f4b9 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:29:52.469131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 764/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:29:53.294042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acc6a6-9a9b-4d4f-9814-a8351da8f0ae None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:53.294947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acc6a6-9a9b-4d4f-9814-a8351da8f0ae None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:53.294947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acc6a6-9a9b-4d4f-9814-a8351da8f0ae None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:53.297244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:29:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:29:53.303304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91b0b-efbe-4cab-9f54-c3141a3c74cd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:53.304168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91b0b-efbe-4cab-9f54-c3141a3c74cd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:53.304351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91b0b-efbe-4cab-9f54-c3141a3c74cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:53.324191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1da91b0b-efbe-4cab-9f54-c3141a3c74cd None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:53.325344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1da91b0b-efbe-4cab-9f54-c3141a3c74cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:53.334692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:53.488940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acc6a6-9a9b-4d4f-9814-a8351da8f0ae None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:29:53.513723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acc6a6-9a9b-4d4f-9814-a8351da8f0ae None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:29:53.520521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444c8c9-6e7e-4efc-8571-747075dbc1bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:29:53.521211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444c8c9-6e7e-4efc-8571-747075dbc1bb service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:53.521495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444c8c9-6e7e-4efc-8571-747075dbc1bb service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:53.521772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444c8c9-6e7e-4efc-8571-747075dbc1bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:53.530680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444c8c9-6e7e-4efc-8571-747075dbc1bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:29:53.532284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444c8c9-6e7e-4efc-8571-747075dbc1bb service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:29:53.543223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 762/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:29:57.509736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e261-6ba4-4ecc-b95e-9718322e0d71 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:57.510570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e261-6ba4-4ecc-b95e-9718322e0d71 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:57.510570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8e261-6ba4-4ecc-b95e-9718322e0d71 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:57.512535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:29:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:29:57.518124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2791f-6754-4e00-b8d0-b384a4a84e55 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:57.518585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2791f-6754-4e00-b8d0-b384a4a84e55 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:57.518694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2791f-6754-4e00-b8d0-b384a4a84e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:57.542557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e5b2791f-6754-4e00-b8d0-b384a4a84e55 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:57.543771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e5b2791f-6754-4e00-b8d0-b384a4a84e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:57.553100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:57.593112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e261-6ba4-4ecc-b95e-9718322e0d71 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:29:57.595445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c2d8e261-6ba4-4ecc-b95e-9718322e0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:57.661816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8e261-6ba4-4ecc-b95e-9718322e0d71 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:29:57.665726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a89a-7a7b-406f-93ea-c05d141cc272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:29:57.666372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a89a-7a7b-406f-93ea-c05d141cc272 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:57.666655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a89a-7a7b-406f-93ea-c05d141cc272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:57.666940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a89a-7a7b-406f-93ea-c05d141cc272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:57.676617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a89a-7a7b-406f-93ea-c05d141cc272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:29:57.678089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a89a-7a7b-406f-93ea-c05d141cc272 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:29:57.683844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:29:57.689536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 767/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:29:59.723193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2efe42-4e6b-481b-98ab-97825c68c94b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:59.723904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2efe42-4e6b-481b-98ab-97825c68c94b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:59.723904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2efe42-4e6b-481b-98ab-97825c68c94b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:59.726189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:29:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:29:59.731834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b3e23-c1f5-4680-b456-05f67d0d396c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:59.732284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b3e23-c1f5-4680-b456-05f67d0d396c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:59.732393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b3e23-c1f5-4680-b456-05f67d0d396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:59.753883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4c1b3e23-c1f5-4680-b456-05f67d0d396c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:29:59.755095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c1b3e23-c1f5-4680-b456-05f67d0d396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:59.764638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:29:59.801870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2efe42-4e6b-481b-98ab-97825c68c94b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:29:59.805019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ec2efe42-4e6b-481b-98ab-97825c68c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:29:59.825273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2efe42-4e6b-481b-98ab-97825c68c94b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:29:59.829669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e2bb7-62d5-42c4-84f6-5709ecf592b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:29:59.830307 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2bb7-62d5-42c4-84f6-5709ecf592b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:29:59.830588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2bb7-62d5-42c4-84f6-5709ecf592b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:29:59.830862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e2bb7-62d5-42c4-84f6-5709ecf592b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:29:59.846752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e2bb7-62d5-42c4-84f6-5709ecf592b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:29:59.849079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e2bb7-62d5-42c4-84f6-5709ecf592b2 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:29:59.860295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 765/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:30:03.365786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a477a-39b1-4c02-914e-2e40f7a7c91e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:30:03.366396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a477a-39b1-4c02-914e-2e40f7a7c91e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:30:03.366396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a477a-39b1-4c02-914e-2e40f7a7c91e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:30:03.368133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:30:03.376947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aebb82-bc7e-4296-94f0-70b18f58d9f2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:30:03.377727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aebb82-bc7e-4296-94f0-70b18f58d9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:30:03.377889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aebb82-bc7e-4296-94f0-70b18f58d9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:30:03.400404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-32aebb82-bc7e-4296-94f0-70b18f58d9f2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:30:03.401646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-32aebb82-bc7e-4296-94f0-70b18f58d9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:30:03.410945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:30:03.712525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a477a-39b1-4c02-914e-2e40f7a7c91e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:30:03.714545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab3a477a-39b1-4c02-914e-2e40f7a7c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:30:03.782855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a477a-39b1-4c02-914e-2e40f7a7c91e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:30:03.787396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d26f12-5af7-411a-a5af-6a213035f151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:30:03.788224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d26f12-5af7-411a-a5af-6a213035f151 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:30:03.788882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d26f12-5af7-411a-a5af-6a213035f151 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:30:03.789162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d26f12-5af7-411a-a5af-6a213035f151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:30:03.799173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d26f12-5af7-411a-a5af-6a213035f151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:30:03.800602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d26f12-5af7-411a-a5af-6a213035f151 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:30:03.813972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 770/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:30:05.859178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28c6d-e38f-4068-a1e7-41cf0a39bc8c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:30:05.859763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28c6d-e38f-4068-a1e7-41cf0a39bc8c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:30:05.859763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28c6d-e38f-4068-a1e7-41cf0a39bc8c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:30:05.861160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:30:05.867654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329679-7178-4a08-9133-8b549148fb2d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:30:05.868424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329679-7178-4a08-9133-8b549148fb2d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:30:05.868622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce329679-7178-4a08-9133-8b549148fb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:30:05.892468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ce329679-7178-4a08-9133-8b549148fb2d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:30:05.893757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ce329679-7178-4a08-9133-8b549148fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:30:05.903279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:30:06.204952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c28c6d-e38f-4068-a1e7-41cf0a39bc8c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:30:06.207034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-69c28c6d-e38f-4068-a1e7-41cf0a39bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:30:06.215681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=65 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:30:06.222582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c28c6d-e38f-4068-a1e7-41cf0a39bc8c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:30:06.227251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f453ea-102b-4e28-a01d-0f40a3419279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:30:06.227896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f453ea-102b-4e28-a01d-0f40a3419279 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:30:06.228172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f453ea-102b-4e28-a01d-0f40a3419279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:30:06.228447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f453ea-102b-4e28-a01d-0f40a3419279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:30:06.238298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f453ea-102b-4e28-a01d-0f40a3419279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:30:06.239759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f453ea-102b-4e28-a01d-0f40a3419279 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:30:06.250397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 768/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:30:15.886971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=32 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:30:16.246209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:36.600874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1bd8-f4e7-4580-9b75-c19a04863594 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:36.602181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1bd8-f4e7-4580-9b75-c19a04863594 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:36.602710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c1bd8-f4e7-4580-9b75-c19a04863594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:36.629290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9a3c1bd8-f4e7-4580-9b75-c19a04863594 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:36.630997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9a3c1bd8-f4e7-4580-9b75-c19a04863594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:36.640569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 772/1540] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:36.651634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2832-a537-4919-a20b-64ce82587e64 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:36.652219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2832-a537-4919-a20b-64ce82587e64 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:36.652219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2832-a537-4919-a20b-64ce82587e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:36.675810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-269a2832-a537-4919-a20b-64ce82587e64 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:36.677114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-269a2832-a537-4919-a20b-64ce82587e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:36.693242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 769/1541] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:31:36.697933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1bd8-f4e7-4580-9b75-c19a04863594 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:36.711815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c1bd8-f4e7-4580-9b75-c19a04863594 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:36.720033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:36.721089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:36.721601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:36.722155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:36.723211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:36.723738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:36.725621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:36.747575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 773/1542] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:36.765237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a2832-a537-4919-a20b-64ce82587e64 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:36.775344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a2832-a537-4919-a20b-64ce82587e64 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:36.784911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:36.785850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:36.786132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:36.786408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:36.787109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:36.789067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:36.830026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 770/1543] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:36 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:36.834590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:36.851343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9880c-43a8-48f3-9392-c13dca5ca97a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:36.920042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:36.921176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:36.921681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:36.922271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:36.923211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:36.925530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:36.966247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 774/1544] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:36 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:36.971156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:36.989331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25560c51-f7db-4fcb-87bf-086223d80462 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:36.996257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:36.997042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:36.997321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:36.997606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:36.998333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.000351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.016536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 771/1545] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:37.020992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.038147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1725-3f84-410a-8053-3b0746c89e4a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.051542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9687f-1bc7-4476-97b7-648ad656b989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.053078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9687f-1bc7-4476-97b7-648ad656b989 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.053924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9687f-1bc7-4476-97b7-648ad656b989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.054437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9687f-1bc7-4476-97b7-648ad656b989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.055454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9687f-1bc7-4476-97b7-648ad656b989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.057435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9687f-1bc7-4476-97b7-648ad656b989 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.080420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 775/1546] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:37.085459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.098726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9637026-1d37-48ba-8e33-a2ff9f78709a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.110089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.111295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.111756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.112184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] PATH_INFO: `/v3/projects/79f95e1a5e3648f3af0429bed0e6c171/users/5a17f3ec8f4d43049b61688a0578cd2e/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.136984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f95e1a5e3648f3af0429bed0e6c171, user_id=5a17f3ec8f4d43049b61688a0578cd2e, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.140506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.170118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 772/1547] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:37 2022] PUT /identity/v3/projects/79f95e1a5e3648f3af0429bed0e6c171/users/5a17f3ec8f4d43049b61688a0578cd2e/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:37.176180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567bc0d-01e9-4773-86d8-dc5bac4c3847 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.176458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567bc0d-01e9-4773-86d8-dc5bac4c3847 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.176757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567bc0d-01e9-4773-86d8-dc5bac4c3847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.217816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3567bc0d-01e9-4773-86d8-dc5bac4c3847 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.219160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3567bc0d-01e9-4773-86d8-dc5bac4c3847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.312353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 776/1548] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.326840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.403749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26042b-d4b9-43b8-9835-f84222cf6843 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.404641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e9567-e58b-4a44-ad75-c2daa0f971bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.409706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e9567-e58b-4a44-ad75-c2daa0f971bd service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.410287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e9567-e58b-4a44-ad75-c2daa0f971bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.410842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e9567-e58b-4a44-ad75-c2daa0f971bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.419570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170953e-af8f-48e0-9567-74cc781a7fa5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.419913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170953e-af8f-48e0-9567-74cc781a7fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.420125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170953e-af8f-48e0-9567-74cc781a7fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.427726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e9567-e58b-4a44-ad75-c2daa0f971bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.429356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e9567-e58b-4a44-ad75-c2daa0f971bd service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.458325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 773/1549] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:37.459889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1cbb7-66bd-4f76-9e55-883a2c7070d7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.460179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1cbb7-66bd-4f76-9e55-883a2c7070d7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.460628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1cbb7-66bd-4f76-9e55-883a2c7070d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.476865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4170953e-af8f-48e0-9567-74cc781a7fa5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.478097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4170953e-af8f-48e0-9567-74cc781a7fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.503921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-dec1cbb7-66bd-4f76-9e55-883a2c7070d7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.505427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dec1cbb7-66bd-4f76-9e55-883a2c7070d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.516330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 774/1550] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.517792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11266-b84f-4c2a-95ea-bee129fc2f87 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.518083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11266-b84f-4c2a-95ea-bee129fc2f87 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.518364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11266-b84f-4c2a-95ea-bee129fc2f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.529267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 777/1551] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.530349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8b29-dfd0-40b5-8a8d-7a8aab13e13f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.530643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8b29-dfd0-40b5-8a8d-7a8aab13e13f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.530921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8b29-dfd0-40b5-8a8d-7a8aab13e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.548981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a3f11266-b84f-4c2a-95ea-bee129fc2f87 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.551327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a3f11266-b84f-4c2a-95ea-bee129fc2f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.571378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2bfe8b29-dfd0-40b5-8a8d-7a8aab13e13f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.575728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 775/1552] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.575890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2bfe8b29-dfd0-40b5-8a8d-7a8aab13e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.575986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d376ba-9638-47b2-b313-20ac7e8cb442 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.575986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d376ba-9638-47b2-b313-20ac7e8cb442 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.575986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d376ba-9638-47b2-b313-20ac7e8cb442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.584034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 778/1553] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.585373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c621-c48a-4d78-b402-b3785a693f4a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.585785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c621-c48a-4d78-b402-b3785a693f4a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.586158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4c621-c48a-4d78-b402-b3785a693f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.597792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-36d376ba-9638-47b2-b313-20ac7e8cb442 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.599076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-36d376ba-9638-47b2-b313-20ac7e8cb442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.606745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-31f4c621-c48a-4d78-b402-b3785a693f4a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.607327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 776/1554] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.608326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31f4c621-c48a-4d78-b402-b3785a693f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.610323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127207c-704c-49fa-bf56-9b3a5c73aaf3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.610620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127207c-704c-49fa-bf56-9b3a5c73aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.610906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127207c-704c-49fa-bf56-9b3a5c73aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.620221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 779/1555] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.621808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be61edb-189e-410e-b172-7f77cd3b370c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.622162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be61edb-189e-410e-b172-7f77cd3b370c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.622559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be61edb-189e-410e-b172-7f77cd3b370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.637751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2127207c-704c-49fa-bf56-9b3a5c73aaf3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.638969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2127207c-704c-49fa-bf56-9b3a5c73aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.642473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6be61edb-189e-410e-b172-7f77cd3b370c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.643469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6be61edb-189e-410e-b172-7f77cd3b370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.648340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 777/1556] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.649525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0279e-33b4-4ab7-bd28-4f163602304c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.649818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0279e-33b4-4ab7-bd28-4f163602304c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.650094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0279e-33b4-4ab7-bd28-4f163602304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.655732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 780/1557] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.659213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc353a7-10ce-422c-87d2-4511c39681b8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.659584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc353a7-10ce-422c-87d2-4511c39681b8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.659998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc353a7-10ce-422c-87d2-4511c39681b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.670411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-64a0279e-33b4-4ab7-bd28-4f163602304c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.672207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-64a0279e-33b4-4ab7-bd28-4f163602304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.680746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 778/1558] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.680922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5cc353a7-10ce-422c-87d2-4511c39681b8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.682051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83dc87-8037-4166-b300-e448fbb7c4a3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.682340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83dc87-8037-4166-b300-e448fbb7c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.682739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83dc87-8037-4166-b300-e448fbb7c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.690571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5cc353a7-10ce-422c-87d2-4511c39681b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.699043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 781/1559] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.700129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc353a7-10ce-422c-87d2-4511c39681b8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.701492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5f83dc87-8037-4166-b300-e448fbb7c4a3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.702843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5f83dc87-8037-4166-b300-e448fbb7c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.716771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 779/1560] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.717274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc353a7-10ce-422c-87d2-4511c39681b8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.718817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab45d-060c-4b42-85d7-7334a9925f89 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.719108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab45d-060c-4b42-85d7-7334a9925f89 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.719392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ab45d-060c-4b42-85d7-7334a9925f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.726613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.727705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.728070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.728407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.730500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:37.731311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.733832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.742935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-290ab45d-060c-4b42-85d7-7334a9925f89 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.744885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-290ab45d-060c-4b42-85d7-7334a9925f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.749180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 782/1561] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:37.750213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.764403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423a610-b7e4-42bb-8468-9df8d07a77ac admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.764661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 780/1562] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.764661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77271d06-f0db-4281-87be-ee923cf54bf5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.764661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77271d06-f0db-4281-87be-ee923cf54bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.764661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77271d06-f0db-4281-87be-ee923cf54bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.771428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6467b79-bbb4-4d3e-81f0-d37f8238a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.773115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467b79-bbb4-4d3e-81f0-d37f8238a709 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.774283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467b79-bbb4-4d3e-81f0-d37f8238a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.774641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6467b79-bbb4-4d3e-81f0-d37f8238a709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.775914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467b79-bbb4-4d3e-81f0-d37f8238a709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:37.776301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467b79-bbb4-4d3e-81f0-d37f8238a709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.778457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6467b79-bbb4-4d3e-81f0-d37f8238a709 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.786038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-77271d06-f0db-4281-87be-ee923cf54bf5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.787285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-77271d06-f0db-4281-87be-ee923cf54bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.790200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:37.793929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 783/1563] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:37.795462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10791ae-7487-4227-98b3-bc8744bee4fa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.796085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10791ae-7487-4227-98b3-bc8744bee4fa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.796611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10791ae-7487-4227-98b3-bc8744bee4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.806893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 781/1564] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.807805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77271d06-f0db-4281-87be-ee923cf54bf5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.818383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77271d06-f0db-4281-87be-ee923cf54bf5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.821604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b10791ae-7487-4227-98b3-bc8744bee4fa None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:37.823267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b10791ae-7487-4227-98b3-bc8744bee4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:37.823395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.824330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.824330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.824546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.825123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:37.825430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.826685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:31:37.826685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: warnings.warn(msg) Jun 23 11:31:37.826685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: Jun 23 11:31:37.828127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.833364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 784/1565] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:37.834119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10791ae-7487-4227-98b3-bc8744bee4fa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.842421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 782/1566] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:37.843245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.845022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10791ae-7487-4227-98b3-bc8744bee4fa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.849798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.850624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.850896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.851177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.851997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:37.852306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.854182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.858547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78847e26-eacb-4759-a09c-1fcdd97f503d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.865792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.866635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.866924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.867425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.867563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 785/1567] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:37.867870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.868296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.870287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.882781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4956cf-dfed-474e-b5d4-63cbf6517da4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.888467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.889246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.889602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.889949 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.890709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:37.891018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.892990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:37.906765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 786/1568] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:37.907607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.911212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 783/1569] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:37.911212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:37.928007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:37.934322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a9d10-f603-4929-95ca-3b746daa0585 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.983953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb4321-0a2b-4941-8ce3-ecc30126890f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:37.992021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:37.992705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:37.993012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:37.993408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:37.994226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:37.994538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:37.997453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.017064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 784/1570] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:38.018040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.018613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.019568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.019999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.020405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.021285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.022463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:31:38.022463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:31:38.022463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:31:38.024462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.029260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906dd1-9348-42b1-8c88-91f5eb77302b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.033874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.034600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.035455 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.035744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.036474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:38.036982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.038713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.060933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 785/1571] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:38.062010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.069917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 787/1572] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:37 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.070824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.077325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d1828-ec06-4ec7-98b1-08f3e579c109 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.142379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.143789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.144050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.144342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.145278 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.147536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.147660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf769df-cfe9-405d-a6b2-178af0f45861 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.152932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.153706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.153993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.154260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.154956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.157015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.184038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 786/1573] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.184038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.191638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 788/1574] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.191638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.238728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:38.263677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b99a18-9944-4d91-8f6c-cc3137b7b6da admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.270832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5a81f-9604-46c2-873a-5defd32f82d9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.271640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.272383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.272743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.273082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.273856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.275699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.276461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.276885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.277226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.277996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.278750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.279305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:31:38.279305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: warnings.warn(msg) Jun 23 11:31:38.279305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: Jun 23 11:31:38.280583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.307554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 787/1575] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.308740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.319884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d2f42-b0af-407e-9519-043ca3355ff8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.326071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.326900 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.327240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.327597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.328611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 789/1576] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.328875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.329487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.330972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.335624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:38.366393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 788/1577] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.370629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.424098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48f8f5-37f0-44c7-84ad-f9b31b214159 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.453678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813cfc6-1675-43aa-b74c-acf47bdcd09e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.459292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.460033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.460325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.460604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.461430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.463492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.491070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 789/1578] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.491933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.497457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.498495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.499079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.499495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.500328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.507855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.509928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42eb59-d26e-4482-b2bf-59b700b47191 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.516677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.517658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.518501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.519182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.519897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.522475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.547970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 790/1579] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.548769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.552827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 790/1580] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.554574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.560791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1379bfa-90f3-47f9-9157-faea2f994862 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.625567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.626267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.626592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.626882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.627712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.630039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.636559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:38.645901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c090dbb-31d0-4644-bbc1-b841e401ac21 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.654477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.655193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 791/1581] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.655798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.656138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.656241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.656413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.657288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.659546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.668443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34a9c8-d3cd-401e-87dd-0c12563af28a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.673176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 791/1582] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.673176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.679495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.680928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.681913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.682404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.683074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fa9f8-a2bc-435c-9567-f7af10a3a2b6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.683537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.687174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.690770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.691684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.692082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.693318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.693318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.695689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.717434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 792/1583] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.718896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.733941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 792/1584] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/users => generated 286 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.733941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.734281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e5a53-1bbc-465f-8798-045a32badaf2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.740547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.741396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.741843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.742141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.742991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.745018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.750195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ce1b-a0f4-473c-879c-cb17b3d41ed7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.755773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.756702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.757007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.757346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.758133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.760267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.770146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 793/1585] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.772164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.776030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 793/1586] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.777229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.786477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73790-0e62-4cf1-8031-6db29824f21d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.789805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369ae6-c298-432e-9c7f-b6c2880cb866 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.794509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.795427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.795927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.796181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.796531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.797115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.797690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.797953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.798772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.799521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.801631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.804266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.817174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 794/1587] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.818284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.834221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a9e0-a8f6-4a3d-9f89-9e3e214182f1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.837946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 794/1588] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:38 2022] POST /identity/v3/users => generated 288 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:38.838874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.846739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.848008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.848454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.849185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.850329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.852101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f9d6-eb44-4970-85d0-aaf34d31fb01 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.854536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.856693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:38.860645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.870984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.871269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.871549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.873574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.875329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.882115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 795/1589] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.883178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.896889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 795/1590] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.896889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.902825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553adb1-b883-4907-a34a-171a1f93be82 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.907310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507f382-654d-417f-b525-c5454ab0ef6b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.911924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.913425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.913718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.914092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.914212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.915008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.915124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.915912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.916744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.916887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.917626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.919346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.933316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 796/1591] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.936831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.936963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 796/1592] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.936963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.948483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e639f-9bff-4a9e-8e4e-e25114a6cde4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.951034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5000f06-08fe-4c88-95a1-be7c90c2b7c1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.956027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.956748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:38.957021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.957365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.957648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:38.957762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.958054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:38.958730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:38.959504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.959983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:38.961924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.962265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:38.979405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 797/1593] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.979405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.979676 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 797/1594] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:38.980690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:38.994206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bac6c-17dc-4252-9ca4-d139bb7af79f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:38.994357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac3a95-2b49-4dc5-8251-1a641b3db0f1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.001552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.001925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.002631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.002986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.003366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.003536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.003993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.004373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] PATH_INFO: `/v3/projects/22bc5a3943fb49589ae88a56c955a8cd/users/f96e6bc11a9a4693955dea424e969e74/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.004832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.008235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.023901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 798/1595] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:39.026261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.030242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bc5a3943fb49589ae88a56c955a8cd, user_id=f96e6bc11a9a4693955dea424e969e74, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.033083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:31:39.033083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:31:39.033083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:31:39.040866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c01eb-d04e-40ec-ac98-be66479b7312 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.042565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.057212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.057212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.057212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.057212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.057692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.059426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.067372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 798/1596] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:38 2022] PUT /identity/v3/projects/22bc5a3943fb49589ae88a56c955a8cd/users/f96e6bc11a9a4693955dea424e969e74/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:39.068205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.074119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 799/1597] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:39.075197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.097717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8633d-20c5-4dca-96d9-da569f915208 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.159771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ecd77-8e22-473f-af6e-414807d56250 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.166058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.167107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.167402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.167698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] PATH_INFO: `/v3/projects/c2d9ba08e42b48fa9d6e9f61bcc4a1c5/users/63b4797743bc4de093eb8e14214f8870/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.174099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.174801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.175299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.175577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.176317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.178354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.187087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d9ba08e42b48fa9d6e9f61bcc4a1c5, user_id=63b4797743bc4de093eb8e14214f8870, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.189363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 800/1598] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:39.190394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.193841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.204471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68e68f-4f05-4c1e-92de-84b2a26cfdc9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.212911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 799/1599] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:39 2022] PUT /identity/v3/projects/c2d9ba08e42b48fa9d6e9f61bcc4a1c5/users/63b4797743bc4de093eb8e14214f8870/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:39.213883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.262925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:39.289999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067b842-95c8-4411-891b-edd9f131e6c6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.296246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.296686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179f4a3-c2ed-486c-8e3d-f95220c2a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.297779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.297779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.297972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f4a3-c2ed-486c-8e3d-f95220c2a708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.298051 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] PATH_INFO: `/v3/projects/2e782c02413f471e945bb61e003e685d/users/1903cd549e764595b2a1be04487f96eb/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.298144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f4a3-c2ed-486c-8e3d-f95220c2a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.298221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179f4a3-c2ed-486c-8e3d-f95220c2a708 admin admin] PATH_INFO: `/v3/projects/3efb347e07c548b5bf834bcf6fb257cd/users/24f5af5372d943d78ae31f13fea361e2/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.376079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e782c02413f471e945bb61e003e685d, user_id=1903cd549e764595b2a1be04487f96eb, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.376079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.377996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179f4a3-c2ed-486c-8e3d-f95220c2a708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efb347e07c548b5bf834bcf6fb257cd, user_id=24f5af5372d943d78ae31f13fea361e2, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.377996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179f4a3-c2ed-486c-8e3d-f95220c2a708 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.378423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 800/1600] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:39 2022] PUT /identity/v3/projects/2e782c02413f471e945bb61e003e685d/users/1903cd549e764595b2a1be04487f96eb/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:39.378423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.379171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 801/1601] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:39 2022] PUT /identity/v3/projects/3efb347e07c548b5bf834bcf6fb257cd/users/24f5af5372d943d78ae31f13fea361e2/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:39.379171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea942e2-7537-4f6f-9886-71d696365277 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.379171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea942e2-7537-4f6f-9886-71d696365277 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.379171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea942e2-7537-4f6f-9886-71d696365277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.397929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6ea942e2-7537-4f6f-9886-71d696365277 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:39.399674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6ea942e2-7537-4f6f-9886-71d696365277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:39.441696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:39.474873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b077d-ea07-4853-84a0-689611407e86 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.484907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 802/1602] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:39.485372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea942e2-7537-4f6f-9886-71d696365277 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.495678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea942e2-7537-4f6f-9886-71d696365277 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.500608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.501817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.502105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.502380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] PATH_INFO: `/v3/projects/577c6cccc1594e889494287d46b060eb/users/260d06b387034121b58e8d1f266db2de/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.520137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=577c6cccc1594e889494287d46b060eb, user_id=260d06b387034121b58e8d1f266db2de, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.522904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.542705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 803/1603] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:39 2022] PUT /identity/v3/projects/577c6cccc1594e889494287d46b060eb/users/260d06b387034121b58e8d1f266db2de/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:39.543653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.554736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72d543-eab2-4134-a92a-8528fcd13eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.555536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d543-eab2-4134-a92a-8528fcd13eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.555657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d543-eab2-4134-a92a-8528fcd13eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.555890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72d543-eab2-4134-a92a-8528fcd13eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.557137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72d543-eab2-4134-a92a-8528fcd13eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.558360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72d543-eab2-4134-a92a-8528fcd13eaa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.570334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 801/1604] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:39.571815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9631a89-4a81-4c56-bf0d-447ed1664d6b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.572111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9631a89-4a81-4c56-bf0d-447ed1664d6b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.572409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9631a89-4a81-4c56-bf0d-447ed1664d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.601890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f9631a89-4a81-4c56-bf0d-447ed1664d6b None None] MFA Rules not processed for user `63b4797743bc4de093eb8e14214f8870`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:39.603200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9631a89-4a81-4c56-bf0d-447ed1664d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:39.623544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4711-f822-4d8c-adc9-7ca0b2c7fb45 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:39.629170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503703e-f113-4170-933f-a5a481248bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:39.630176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503703e-f113-4170-933f-a5a481248bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.630527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503703e-f113-4170-933f-a5a481248bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.630875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503703e-f113-4170-933f-a5a481248bb7 admin admin] PATH_INFO: `/v3/projects/ff04cf4c7d764deab3e2d5cb01317a9d/users/ffce932f59584c44a32bec2ce2b9fd8a/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.652159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:39.655339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503703e-f113-4170-933f-a5a481248bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff04cf4c7d764deab3e2d5cb01317a9d, user_id=ffce932f59584c44a32bec2ce2b9fd8a, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:39.659472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503703e-f113-4170-933f-a5a481248bb7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:39.675300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 802/1605] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:39.679271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079bc61-5565-47e8-9075-b88fe843cb7d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.679271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079bc61-5565-47e8-9075-b88fe843cb7d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.679271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079bc61-5565-47e8-9075-b88fe843cb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.679573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 804/1606] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:39 2022] PUT /identity/v3/projects/ff04cf4c7d764deab3e2d5cb01317a9d/users/ffce932f59584c44a32bec2ce2b9fd8a/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:39.679573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbe44-05cd-4365-abe5-d58ae5d89a57 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.680071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbe44-05cd-4365-abe5-d58ae5d89a57 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.680372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fbe44-05cd-4365-abe5-d58ae5d89a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.704149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2079bc61-5565-47e8-9075-b88fe843cb7d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:39.705441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2079bc61-5565-47e8-9075-b88fe843cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:39.720015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-431fbe44-05cd-4365-abe5-d58ae5d89a57 None None] MFA Rules not processed for user `24f5af5372d943d78ae31f13fea361e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:39.721321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-431fbe44-05cd-4365-abe5-d58ae5d89a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:39.790419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 803/1607] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:39.793512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079bc61-5565-47e8-9075-b88fe843cb7d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:39.815655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 805/1608] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:39.817856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669d0f9-69a9-4ef8-b65e-047f6ca49dcd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:39.818359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669d0f9-69a9-4ef8-b65e-047f6ca49dcd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:39.818804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669d0f9-69a9-4ef8-b65e-047f6ca49dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:39.866226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0669d0f9-69a9-4ef8-b65e-047f6ca49dcd None None] MFA Rules not processed for user `260d06b387034121b58e8d1f266db2de`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:39.868445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0669d0f9-69a9-4ef8-b65e-047f6ca49dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:39.900287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:40.002160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 806/1609] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:40.002160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669d0f9-69a9-4ef8-b65e-047f6ca49dcd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.016620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669d0f9-69a9-4ef8-b65e-047f6ca49dcd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.025018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.026137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.026524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.027061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] PATH_INFO: `/v3/projects/70553711ebfc423ea1cf7b6c3cababd9/users/73c9e36a6c5f4bc8962ef86d39c496cb/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.049879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70553711ebfc423ea1cf7b6c3cababd9, user_id=73c9e36a6c5f4bc8962ef86d39c496cb, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:40.058402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:40.064094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079bc61-5565-47e8-9075-b88fe843cb7d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.070862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c78b6b-0e18-41c4-8b99-94f80a8428b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.071372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78b6b-0e18-41c4-8b99-94f80a8428b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.071661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78b6b-0e18-41c4-8b99-94f80a8428b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.072764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78b6b-0e18-41c4-8b99-94f80a8428b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.081136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 807/1610] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:39 2022] PUT /identity/v3/projects/70553711ebfc423ea1cf7b6c3cababd9/users/73c9e36a6c5f4bc8962ef86d39c496cb/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:40.082435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.094337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c78b6b-0e18-41c4-8b99-94f80a8428b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:40.096032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c78b6b-0e18-41c4-8b99-94f80a8428b2 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:40.115247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 804/1611] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:40.116604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ec91c-201b-48b0-85b0-d3c93708bce0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.116920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ec91c-201b-48b0-85b0-d3c93708bce0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.117196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ec91c-201b-48b0-85b0-d3c93708bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.175109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-634ec91c-201b-48b0-85b0-d3c93708bce0 None None] MFA Rules not processed for user `ffce932f59584c44a32bec2ce2b9fd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:40.176356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-634ec91c-201b-48b0-85b0-d3c93708bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:40.176999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b9f84-38ec-41ed-90e2-b3ad6e7a8fd6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.182955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.184012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.184533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.185225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.186424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:40.188895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:40.252647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 808/1612] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:40.260650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.349869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a358f0-944b-4011-b022-fc4456744654 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.354652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd42da2-a4bb-483c-8e08-3ceddf583a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.355324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42da2-a4bb-483c-8e08-3ceddf583a5f service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.355604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42da2-a4bb-483c-8e08-3ceddf583a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.356187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd42da2-a4bb-483c-8e08-3ceddf583a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.376925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 805/1613] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:40.382250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b86b6-24d1-4771-bf88-265aaad8b0d5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.382641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b86b6-24d1-4771-bf88-265aaad8b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.389672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b86b6-24d1-4771-bf88-265aaad8b0d5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.391457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:40.391766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 806/1614] 10.222.0.66 () {54 vars in 961 bytes} [Thu Jun 23 11:31:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:31:40.392790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b86b6-24d1-4771-bf88-265aaad8b0d5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.442155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:40.478876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd42da2-a4bb-483c-8e08-3ceddf583a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:40.480598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd42da2-a4bb-483c-8e08-3ceddf583a5f service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:40.507952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 809/1615] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:40.509425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cae0-9ec0-41af-9f47-a35d7006c84a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.509718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cae0-9ec0-41af-9f47-a35d7006c84a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.520751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cae0-9ec0-41af-9f47-a35d7006c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.550312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5826cae0-9ec0-41af-9f47-a35d7006c84a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:40.551612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5826cae0-9ec0-41af-9f47-a35d7006c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:40.556646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b86b6-24d1-4771-bf88-265aaad8b0d5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.567484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.568607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.569163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.569539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.570413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:40.576670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:40.578364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 810/1616] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:40.579290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826cae0-9ec0-41af-9f47-a35d7006c84a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.603589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826cae0-9ec0-41af-9f47-a35d7006c84a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.612428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3679df-5922-4598-86e2-7b1536364d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.613250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3679df-5922-4598-86e2-7b1536364d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.613539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3679df-5922-4598-86e2-7b1536364d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.613826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3679df-5922-4598-86e2-7b1536364d33 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.614546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3679df-5922-4598-86e2-7b1536364d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:40.616567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3679df-5922-4598-86e2-7b1536364d33 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:40.639239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 807/1617] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:40.640429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.666176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 811/1618] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:40.670554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aea1b-d3de-4e9a-95fb-e8928d691a17 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.670854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aea1b-d3de-4e9a-95fb-e8928d691a17 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.671122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aea1b-d3de-4e9a-95fb-e8928d691a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.715669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7a3aea1b-d3de-4e9a-95fb-e8928d691a17 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:40.719549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7a3aea1b-d3de-4e9a-95fb-e8928d691a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:40.741038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fa09f-f90d-4d05-b1f6-6fdb8dff0029 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.760465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.761598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.762586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.763047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:40.763924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:40.766900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:40.825226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 808/1619] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:40.826326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.884249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 812/1620] 10.222.0.66 () {58 vars in 1058 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:40.885222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3aea1b-d3de-4e9a-95fb-e8928d691a17 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:40.902202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3aea1b-d3de-4e9a-95fb-e8928d691a17 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.952215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821d1e-7927-4ee5-a935-2c2b14b86059 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:40.969270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:40.970028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:40.970417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:40.970788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.013980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.014820 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.014987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.015274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.016081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.018197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.047505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 813/1621] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:40 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:41.059065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.070310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:41.072318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f4e47-ffba-4797-8414-48c16914f481 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.080505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.081595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.081945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.083197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.083337 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.085209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.097315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 814/1622] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:41.101826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.113121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db2c47-90e8-4e00-a7f7-c19c6e5fca4f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.113438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.115068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.118553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.119353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.119703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.120042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.121184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.123396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.131991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:41.140482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 809/1623] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:41.142196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.165890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 815/1624] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:41 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:41.165890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.178412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1f7b5-68e6-4c44-838a-5aee30a635de admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.184591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.185573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.185918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.186717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.187413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.189652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.207767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 816/1625] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:41.208969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.221554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b4af1-02d2-4578-a91e-137f6ba0d770 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.228076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.229573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.229573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.229985 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] PATH_INFO: `/v3/projects/8f25700b0f1f4fa092a8e8c6ffce4ec4/users/df5fa29f076e42cfa4b608265da4a6a5/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.249838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f25700b0f1f4fa092a8e8c6ffce4ec4, user_id=df5fa29f076e42cfa4b608265da4a6a5, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.253134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.278095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 817/1626] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:41 2022] PUT /identity/v3/projects/8f25700b0f1f4fa092a8e8c6ffce4ec4/users/df5fa29f076e42cfa4b608265da4a6a5/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:41.280049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.338192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff7439-a636-476b-8c49-40042ade5ccf service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.367288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8f0dc-3755-4c12-a26f-0df59eb6e6fe admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.374015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.374980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.375542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.375919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.376973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.380098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.397436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 818/1627] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:41.397436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.423862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf069e2-2d59-498a-86ab-6b800c94fad3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.438712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.443890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.444585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.445327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] PATH_INFO: `/v3/projects/3fbeefcc78f94112b38a45ca579b4e5d/users/1daf57834d9b423b82fe196697de82cd/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.489174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbeefcc78f94112b38a45ca579b4e5d, user_id=1daf57834d9b423b82fe196697de82cd, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.496051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.508311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.509206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.509593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.510002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.545825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 819/1628] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:41 2022] PUT /identity/v3/projects/3fbeefcc78f94112b38a45ca579b4e5d/users/1daf57834d9b423b82fe196697de82cd/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:41.546962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.645404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.647255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.660199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 810/1629] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:41.661661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.679720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc614d-2a7f-4392-9404-0b4fa547dc90 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.687659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059b0f9-e814-41fe-910e-046be2227b98 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.692208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.693177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.693460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.693742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] PATH_INFO: `/v3/projects/1a6baa09da864596b1a2393af5c88cc9/users/feaa47914cdc47b49f0e3118c4254771/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.705033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.706534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.706855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.707228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.708153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.712958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.730067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:41.734548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 820/1630] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:41.740187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6baa09da864596b1a2393af5c88cc9, user_id=feaa47914cdc47b49f0e3118c4254771, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.740901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.753252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd455f-a990-4805-8084-3798d376c1fc admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.765610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:41.768246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:41.770320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:41.770858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.771945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:41.774815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:41.780344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:41.796558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 811/1631] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:41 2022] PUT /identity/v3/projects/1a6baa09da864596b1a2393af5c88cc9/users/feaa47914cdc47b49f0e3118c4254771/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:41.797449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.815313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 821/1632] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:41.822210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:41.853511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa23177-7f64-4a5f-9196-2f5633a7b264 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:41.889096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:41.985911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50bf10-8c0b-47f4-bc22-0e20e3915d24 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:42.006698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:42.007947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.008394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.008934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] PATH_INFO: `/v3/projects/8f25700b0f1f4fa092a8e8c6ffce4ec4/users/df5fa29f076e42cfa4b608265da4a6a5/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.011999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f25700b0f1f4fa092a8e8c6ffce4ec4, user_id=df5fa29f076e42cfa4b608265da4a6a5, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:42.015752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:42.019711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e16f5e-99a9-44c7-af69-090abb05ecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:42.021135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16f5e-99a9-44c7-af69-090abb05ecfa admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.021424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16f5e-99a9-44c7-af69-090abb05ecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.021898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e16f5e-99a9-44c7-af69-090abb05ecfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.022588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e16f5e-99a9-44c7-af69-090abb05ecfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:42.024783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e16f5e-99a9-44c7-af69-090abb05ecfa admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:42.048597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 812/1633] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:41 2022] PUT /identity/v3/projects/8f25700b0f1f4fa092a8e8c6ffce4ec4/users/df5fa29f076e42cfa4b608265da4a6a5/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:42.049537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:42.069659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 822/1634] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:42.074037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8afebb-7dde-4cc3-ba67-5b3b6ae4835a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.074195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8afebb-7dde-4cc3-ba67-5b3b6ae4835a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.074411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8afebb-7dde-4cc3-ba67-5b3b6ae4835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.132031 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5a26b-1be9-4596-8aea-b49784333479 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:42.136421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-db8afebb-7dde-4cc3-ba67-5b3b6ae4835a None None] MFA Rules not processed for user `df5fa29f076e42cfa4b608265da4a6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:42.137783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-db8afebb-7dde-4cc3-ba67-5b3b6ae4835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:42.140121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:42.141419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.141742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.142560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] PATH_INFO: `/v3/projects/3fbeefcc78f94112b38a45ca579b4e5d/users/1daf57834d9b423b82fe196697de82cd/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.145096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbeefcc78f94112b38a45ca579b4e5d, user_id=1daf57834d9b423b82fe196697de82cd, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:42.150072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:42.192787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 813/1635] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:42 2022] PUT /identity/v3/projects/3fbeefcc78f94112b38a45ca579b4e5d/users/1daf57834d9b423b82fe196697de82cd/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:42.192787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:42.283842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 823/1636] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:42.286018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db6e03-135e-4847-a92f-f0b33d21c552 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.286629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db6e03-135e-4847-a92f-f0b33d21c552 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.287057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db6e03-135e-4847-a92f-f0b33d21c552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.320063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-95db6e03-135e-4847-a92f-f0b33d21c552 None None] MFA Rules not processed for user `1daf57834d9b423b82fe196697de82cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:42.321602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-95db6e03-135e-4847-a92f-f0b33d21c552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:42.357058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185ba9-3e7a-4efd-96d0-4e5013cae8bb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:42.370718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41678d1d-22b6-4a3e-96f5-429414dc6d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:42.371776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41678d1d-22b6-4a3e-96f5-429414dc6d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.372159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41678d1d-22b6-4a3e-96f5-429414dc6d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.372868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41678d1d-22b6-4a3e-96f5-429414dc6d42 admin admin] PATH_INFO: `/v3/projects/1a6baa09da864596b1a2393af5c88cc9/users/feaa47914cdc47b49f0e3118c4254771/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.375916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41678d1d-22b6-4a3e-96f5-429414dc6d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6baa09da864596b1a2393af5c88cc9, user_id=feaa47914cdc47b49f0e3118c4254771, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:42.378905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41678d1d-22b6-4a3e-96f5-429414dc6d42 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:42.429672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 814/1637] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:42 2022] PUT /identity/v3/projects/1a6baa09da864596b1a2393af5c88cc9/users/feaa47914cdc47b49f0e3118c4254771/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:42.432301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287055-f891-4040-8d5b-9c6e036aadaa None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.432301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287055-f891-4040-8d5b-9c6e036aadaa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.432301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5287055-f891-4040-8d5b-9c6e036aadaa None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.444790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 815/1638] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jun 23 11:31:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:31:42.445320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5287055-f891-4040-8d5b-9c6e036aadaa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:42.449716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 824/1639] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:42.451737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94078-e751-40ab-80c1-f740b2023276 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.452196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94078-e751-40ab-80c1-f740b2023276 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.452363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94078-e751-40ab-80c1-f740b2023276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.479335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:42.537926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5287055-f891-4040-8d5b-9c6e036aadaa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:42.548190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99b07e-42da-48d1-af03-560ee283d99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:42.550460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99b07e-42da-48d1-af03-560ee283d99f service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.550753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99b07e-42da-48d1-af03-560ee283d99f service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.551271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99b07e-42da-48d1-af03-560ee283d99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.557321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-60c94078-e751-40ab-80c1-f740b2023276 None None] MFA Rules not processed for user `feaa47914cdc47b49f0e3118c4254771`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:42.558587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-60c94078-e751-40ab-80c1-f740b2023276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:42.582421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:42.659662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99b07e-42da-48d1-af03-560ee283d99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:42.662595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99b07e-42da-48d1-af03-560ee283d99f service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:42.677941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 816/1640] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:42.679723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e756-3b6c-4c8e-8240-7565cff1143a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.680184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e756-3b6c-4c8e-8240-7565cff1143a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.680481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e756-3b6c-4c8e-8240-7565cff1143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.724992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7e49e756-3b6c-4c8e-8240-7565cff1143a None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:42.728557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7e49e756-3b6c-4c8e-8240-7565cff1143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:42.765925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 825/1641] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:42.767733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c94078-e751-40ab-80c1-f740b2023276 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:42.801761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c94078-e751-40ab-80c1-f740b2023276 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:42.823951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:42.824674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.825146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.825339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.902475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 817/1642] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:42.904392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49e756-3b6c-4c8e-8240-7565cff1143a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:42.921027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49e756-3b6c-4c8e-8240-7565cff1143a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:42.931025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:42.932196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:42.932654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:42.934719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:42.951672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:42.954186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:42.970038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 818/1643] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:42.996013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:42.999004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:43.027266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 826/1644] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:43.049273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:43.062943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9fc97-6865-49ea-bff8-f6957da00e52 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:43.074534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:43.075457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:43.077076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:43.077402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:43.089008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:43.182717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:43.197216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ab137-1f06-4490-8685-0e10bd2c389d service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:43.202972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:43.204115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:43.204407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:43.205111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] PATH_INFO: `/v3/users/260d06b387034121b58e8d1f266db2de` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:43.206963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=260d06b387034121b58e8d1f266db2de)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:43.209419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:43.220644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:43.222484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:43.245472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 819/1645] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:43.246350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:43.265649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b706615-3fc7-45b3-85b6-ab0595181751 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:43.279000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65a4ff-84ee-49ec-a5d9-87d5c994bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:43.279840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a4ff-84ee-49ec-a5d9-87d5c994bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:43.280121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a4ff-84ee-49ec-a5d9-87d5c994bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:43.280392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65a4ff-84ee-49ec-a5d9-87d5c994bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:43.290984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:43.303572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260d06b387034121b58e8d1f266db2de'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:43.308410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65a4ff-84ee-49ec-a5d9-87d5c994bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:43.313539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65a4ff-84ee-49ec-a5d9-87d5c994bf11 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:43.323714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260d06b387034121b58e8d1f266db2de'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:43.324549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260d06b387034121b58e8d1f266db2de'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:43.325376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260d06b387034121b58e8d1f266db2de'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:43.344608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 820/1646] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:43.347946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260d06b387034121b58e8d1f266db2de'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:43.376627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 827/1647] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:43 2022] DELETE /identity/v3/users/260d06b387034121b58e8d1f266db2de => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:43.377297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978e09-941e-4f3a-9fd5-d80ebef4840a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:43.377587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978e09-941e-4f3a-9fd5-d80ebef4840a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:43.377896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4978e09-941e-4f3a-9fd5-d80ebef4840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:43.410848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e4978e09-941e-4f3a-9fd5-d80ebef4840a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:43.412103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e4978e09-941e-4f3a-9fd5-d80ebef4840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:43.551968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 821/1648] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:31:43.832840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:43.835651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:43.996051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1bca5-55db-4e0f-8449-49c649fca23b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:44.001271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe362d2-1131-4ec1-8a67-ef03d642cd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:44.002798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe362d2-1131-4ec1-8a67-ef03d642cd15 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:44.003409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe362d2-1131-4ec1-8a67-ef03d642cd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:44.003861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe362d2-1131-4ec1-8a67-ef03d642cd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:44.025856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe362d2-1131-4ec1-8a67-ef03d642cd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:44.027434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe362d2-1131-4ec1-8a67-ef03d642cd15 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:44.051150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 828/1649] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:45.174997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb504e-2332-4818-a614-cc85e8509c17 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.174997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb504e-2332-4818-a614-cc85e8509c17 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.174997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb504e-2332-4818-a614-cc85e8509c17 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:45.174997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 822/1650] 10.222.0.66 () {54 vars in 961 bytes} [Thu Jun 23 11:31:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:31:45.177196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b6fc-16db-425d-8c9c-f8628199bf32 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.177196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b6fc-16db-425d-8c9c-f8628199bf32 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.177196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b6fc-16db-425d-8c9c-f8628199bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:45.206395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-06b8b6fc-16db-425d-8c9c-f8628199bf32 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:45.223955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-06b8b6fc-16db-425d-8c9c-f8628199bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:45.415297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb504e-2332-4818-a614-cc85e8509c17 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:45.417286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-65cb504e-2332-4818-a614-cc85e8509c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:45.452212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb504e-2332-4818-a614-cc85e8509c17 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:45.467817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:45.468913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.469229 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.471851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] PATH_INFO: `/v3/users/ffce932f59584c44a32bec2ce2b9fd8a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:45.474984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffce932f59584c44a32bec2ce2b9fd8a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:45.477145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:31:45.477145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: warnings.warn(msg) Jun 23 11:31:45.477145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: Jun 23 11:31:45.482428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:45.489529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 829/1651] 10.222.0.66 () {58 vars in 1058 bytes} [Thu Jun 23 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:45.497642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784b7d-7f89-4369-b058-8eb4c4480593 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.497642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784b7d-7f89-4369-b058-8eb4c4480593 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.498013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a784b7d-7f89-4369-b058-8eb4c4480593 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:45.507193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 830/1652] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jun 23 11:31:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:31:45.509003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a15fc-da22-4031-a3e7-0c2171d93372 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.509315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a15fc-da22-4031-a3e7-0c2171d93372 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.509597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a15fc-da22-4031-a3e7-0c2171d93372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:45.575448 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-368a15fc-da22-4031-a3e7-0c2171d93372 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:45.578907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-368a15fc-da22-4031-a3e7-0c2171d93372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:45.621926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 831/1653] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:45.626730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9637-015b-4943-9055-d2aaec1b7fa7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.627101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9637-015b-4943-9055-d2aaec1b7fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.627384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9637-015b-4943-9055-d2aaec1b7fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:45.635067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffce932f59584c44a32bec2ce2b9fd8a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:45.650487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffce932f59584c44a32bec2ce2b9fd8a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:45.651302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffce932f59584c44a32bec2ce2b9fd8a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:45.652074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffce932f59584c44a32bec2ce2b9fd8a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:45.685540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffce932f59584c44a32bec2ce2b9fd8a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:45.729245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-57bd9637-015b-4943-9055-d2aaec1b7fa7 None None] MFA Rules not processed for user `5a17f3ec8f4d43049b61688a0578cd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:45.729484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 823/1654] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:45 2022] DELETE /identity/v3/users/ffce932f59584c44a32bec2ce2b9fd8a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:45.730466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:45.730571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-57bd9637-015b-4943-9055-d2aaec1b7fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:45.733874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:45.863509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:45.872448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:45.903899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538a8a0-316d-4171-9811-2592b537c394 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:45.918112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:45.918884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.919259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.920108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:45.923640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:45.963519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 832/1655] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:45.965434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:45.965434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:45.965629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:46.005520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:46.006805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:46.088611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:46.090073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:46.114790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 824/1656] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:46.115328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:46.121305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:46.145961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 833/1657] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:46.154642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef034a14-dce0-417c-8dcc-c10c3cab1f7b service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:46.166517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:46.167966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:46.170765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:46.173568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:46.173870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:46.174153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:46.193342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:46.202211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:46.220382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 825/1658] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:46.298014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b1566-a0e3-4e47-899c-b162b88321a5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:46.314869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:46.315941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:46.316367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:46.316933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:46.334851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:46.336638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:46.365649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 834/1659] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:46.397430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:46.400418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:46.443205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec523a-f61a-4c93-85d1-a164c29f05e9 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:46.467189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:46.475638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:46.477316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:46.477625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] PATH_INFO: `/v3/projects/577c6cccc1594e889494287d46b060eb` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:46.484171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=577c6cccc1594e889494287d46b060eb)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:46.489529 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:46.681786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577c6cccc1594e889494287d46b060eb', 'request_id': 'req-97dd3771-ae41-49cc-8403-2c8933ba8d1f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:46.700966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577c6cccc1594e889494287d46b060eb', 'request_id': 'req-97dd3771-ae41-49cc-8403-2c8933ba8d1f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:46.722773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577c6cccc1594e889494287d46b060eb', 'request_id': 'req-97dd3771-ae41-49cc-8403-2c8933ba8d1f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:46.758873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] The token cache is being invalidate because project 577c6cccc1594e889494287d46b060eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:31:46.761259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:46.767664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:46.773159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 826/1660] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:31:46 2022] DELETE /identity/v3/projects/577c6cccc1594e889494287d46b060eb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:46.777390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:46.798068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb9cd0-1baa-450b-93a1-5a17df988f5d service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:46.944268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:46.945502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:46.945942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:46.946363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] PATH_INFO: `/v3/users/1daf57834d9b423b82fe196697de82cd` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:46.949354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1daf57834d9b423b82fe196697de82cd)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:46.954746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:47.002775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:47.079293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1daf57834d9b423b82fe196697de82cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:47.095485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1daf57834d9b423b82fe196697de82cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:47.097482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1daf57834d9b423b82fe196697de82cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:47.100469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1daf57834d9b423b82fe196697de82cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:47.138597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1daf57834d9b423b82fe196697de82cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:47.171959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 835/1661] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:46 2022] DELETE /identity/v3/users/1daf57834d9b423b82fe196697de82cd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:48.971432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:48.973748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:48.995592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd3771-ae41-49cc-8403-2c8933ba8d1f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:49.023622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:49.025216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:49.156196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:49.183792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:49.190374 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:49.193415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:49.194028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] PATH_INFO: `/v3/projects/ff04cf4c7d764deab3e2d5cb01317a9d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:49.198273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff04cf4c7d764deab3e2d5cb01317a9d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:49.201595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:49.222542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941c710-e755-471c-af0a-a1f572c23d73 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:49.243231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:49.252036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:49.252607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:49.257198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] PATH_INFO: `/v3/projects/3fbeefcc78f94112b38a45ca579b4e5d` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:49.260352 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbeefcc78f94112b38a45ca579b4e5d)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:49.261483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:31:49.261483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: warnings.warn(msg) Jun 23 11:31:49.261483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: Jun 23 11:31:49.262695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:49.361678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff04cf4c7d764deab3e2d5cb01317a9d', 'request_id': 'req-b0da6d71-713c-41ec-b3f9-653465c2429c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.374927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff04cf4c7d764deab3e2d5cb01317a9d', 'request_id': 'req-b0da6d71-713c-41ec-b3f9-653465c2429c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.382486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff04cf4c7d764deab3e2d5cb01317a9d', 'request_id': 'req-b0da6d71-713c-41ec-b3f9-653465c2429c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.431201 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] The token cache is being invalidate because project ff04cf4c7d764deab3e2d5cb01317a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:31:49.431768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.432817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbeefcc78f94112b38a45ca579b4e5d', 'request_id': 'req-5df6064a-8ba9-49c6-b973-514549d6f4ab'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.434066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.440884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 827/1662] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:31:48 2022] DELETE /identity/v3/projects/ff04cf4c7d764deab3e2d5cb01317a9d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:49.442574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:49.448054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:49.478038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbeefcc78f94112b38a45ca579b4e5d', 'request_id': 'req-5df6064a-8ba9-49c6-b973-514549d6f4ab'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.506848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbeefcc78f94112b38a45ca579b4e5d', 'request_id': 'req-5df6064a-8ba9-49c6-b973-514549d6f4ab'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.563288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] The token cache is being invalidate because project 3fbeefcc78f94112b38a45ca579b4e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:31:49.563581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.575128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5df6064a-8ba9-49c6-b973-514549d6f4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:49.582043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 836/1663] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:31:49 2022] DELETE /identity/v3/projects/3fbeefcc78f94112b38a45ca579b4e5d => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:31:49.590425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a073-b9f7-4a8a-b780-fdeb571e6a59 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:49.590707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a073-b9f7-4a8a-b780-fdeb571e6a59 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:49.599370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703a073-b9f7-4a8a-b780-fdeb571e6a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:49.671960 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c703a073-b9f7-4a8a-b780-fdeb571e6a59 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:49.674807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c703a073-b9f7-4a8a-b780-fdeb571e6a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:49.711835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da6d71-713c-41ec-b3f9-653465c2429c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:49.742131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:49.904048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 837/1664] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:49.909312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427bce-73db-49d5-85f9-1e3c5b25f0e2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:49.909649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427bce-73db-49d5-85f9-1e3c5b25f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:49.909939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427bce-73db-49d5-85f9-1e3c5b25f0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:49.933472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:49.934399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:49.934678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:49.934951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] PATH_INFO: `/v3/users/feaa47914cdc47b49f0e3118c4254771` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:49.941813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feaa47914cdc47b49f0e3118c4254771)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:49.943767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:49.980362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0a427bce-73db-49d5-85f9-1e3c5b25f0e2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:49.982600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0a427bce-73db-49d5-85f9-1e3c5b25f0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:50.016265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 838/1665] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:50.021887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427bce-73db-49d5-85f9-1e3c5b25f0e2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:50.066445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427bce-73db-49d5-85f9-1e3c5b25f0e2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:50.071642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:50.084334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:50.085284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:50.087109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:50.088167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:50.090425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:50.090831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:50.096397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:50.098773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feaa47914cdc47b49f0e3118c4254771'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:50.119437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feaa47914cdc47b49f0e3118c4254771'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:50.120856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feaa47914cdc47b49f0e3118c4254771'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:50.120856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feaa47914cdc47b49f0e3118c4254771'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:50.138320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 839/1666] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:31:50.142707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:50.146381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:50.177696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feaa47914cdc47b49f0e3118c4254771'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:50.194463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637139c9-e4a1-408b-9903-71a9b73f15fb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:50.208287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:50.210676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:50.211605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:50.212382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 828/1667] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:49 2022] DELETE /identity/v3/users/feaa47914cdc47b49f0e3118c4254771 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:50.214312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:50.216826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:50.221570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:50.297863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 840/1668] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:50 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:50.302673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:50.480329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3057de2-f38a-43c9-a278-cd77e7810fe7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:50.596408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:50.598144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:50.599273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:50.599813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:50.601351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:50.604839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:50.646734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 829/1669] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:50 2022] POST /identity/v3/users => generated 296 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:50.650624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:50.666605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a815f-739b-447b-b73a-26174d971bb1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:50.683212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:50.687611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:50.688259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:50.688640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:50.689445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:50.695548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:50.721848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 841/1670] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:50.726323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:50.743208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6d525-4f22-4f88-9e75-2685978b7999 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:50.752987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07663e-1ad8-4244-89b9-13ddf0e78f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:50.755449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07663e-1ad8-4244-89b9-13ddf0e78f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:50.756814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07663e-1ad8-4244-89b9-13ddf0e78f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:50.757130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07663e-1ad8-4244-89b9-13ddf0e78f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:50.758066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07663e-1ad8-4244-89b9-13ddf0e78f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:50.764363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07663e-1ad8-4244-89b9-13ddf0e78f34 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:50.790063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 830/1671] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:50.794184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:50.809333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e71cc-dc08-491a-b053-3582d1c724bd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:50.826094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:50.827842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:50.828131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:50.828420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] PATH_INFO: `/v3/projects/21b3293632054bf5bb43eae1b96c876e/users/2eaa5d9c3dcd4ab4bb10e799f7e83e7b/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:50.874950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b3293632054bf5bb43eae1b96c876e, user_id=2eaa5d9c3dcd4ab4bb10e799f7e83e7b, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:50.880667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:50.926296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 842/1672] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:50 2022] PUT /identity/v3/projects/21b3293632054bf5bb43eae1b96c876e/users/2eaa5d9c3dcd4ab4bb10e799f7e83e7b/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:31:50.940001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27e563-85eb-42bc-b610-c9a483661ce6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:50.945278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27e563-85eb-42bc-b610-c9a483661ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:50.945815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27e563-85eb-42bc-b610-c9a483661ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:51.027674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9e27e563-85eb-42bc-b610-c9a483661ce6 None None] MFA Rules not processed for user `2eaa5d9c3dcd4ab4bb10e799f7e83e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:51.031146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9e27e563-85eb-42bc-b610-c9a483661ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:51.062142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:51.165678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:51.170140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:51.181143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 831/1673] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:51.186107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27e563-85eb-42bc-b610-c9a483661ce6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:51.317857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86f82-5b34-46e7-948a-14f713b90bef admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:51.325429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:51.326352 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:51.326640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:51.327325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] PATH_INFO: `/v3/users/24f5af5372d943d78ae31f13fea361e2` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:51.329841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f5af5372d943d78ae31f13fea361e2)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:51.332408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:51.360150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27e563-85eb-42bc-b610-c9a483661ce6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:51.376183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:51.376788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:51.377076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:51.377333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:51.380289 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:51.389506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:51.429647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f5af5372d943d78ae31f13fea361e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:51.440055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:51.451680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f5af5372d943d78ae31f13fea361e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:51.456793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f5af5372d943d78ae31f13fea361e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:51.456793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f5af5372d943d78ae31f13fea361e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:51.482890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f0e3a64e-212b-4e4a-86bc-d0f93566976d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f5af5372d943d78ae31f13fea361e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:51.490222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 832/1674] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:51 2022] POST /identity/v3/projects => generated 393 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:51.494814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:51.504130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:51.508788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 843/1675] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:51 2022] DELETE /identity/v3/users/24f5af5372d943d78ae31f13fea361e2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:31:51.513656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:51.514137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:51.519686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:51.548472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:51.550062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:51.721373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 844/1676] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:51.752081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9084-e59a-487b-a1ff-f790ef6bdbc0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:51.775451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:51.777067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:51.785439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:51.786182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:51.786465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:51.786742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:51.787453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:51.789466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:51.860449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 833/1677] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:51 2022] POST /identity/v3/users => generated 303 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:51.863945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:51.904403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615c9fa-ee27-405e-9150-690dcc7f2d3d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:51.940387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:51.947083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:51.947982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:51.948269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:51.954906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:51.956609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:51.969350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 834/1678] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:51.970259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:51.973343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:51.989466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc72405-271d-4bf0-a945-3d14f601cd86 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:51.991684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553d4c-9bfd-45b0-a9a6-b585fe664a5d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:51.995620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:51.996537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:51.996866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:51.997147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] PATH_INFO: `/v3/users/63b4797743bc4de093eb8e14214f8870` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:51.998569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b4797743bc4de093eb8e14214f8870)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.001055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.005521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:52.006290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.007028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.007696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.034574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:52.045711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.046890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.060602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 845/1679] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:52.061479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:52.085778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b4797743bc4de093eb8e14214f8870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.088697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95411a-b266-46b6-94dc-3698d0abbb47 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:52.095490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b4797743bc4de093eb8e14214f8870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.096415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b4797743bc4de093eb8e14214f8870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.097171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b4797743bc4de093eb8e14214f8870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.111403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:52.112747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.113085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.113429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] PATH_INFO: `/v3/projects/6d1d28c3cb534080a1df499e0bff94c1/users/d99a21cd4e7c4d1a86210920ee8f42d5/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.115615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5de12fe9-44c0-4cb8-ad66-d5d05edd14df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b4797743bc4de093eb8e14214f8870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.140985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 835/1680] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:51 2022] DELETE /identity/v3/users/63b4797743bc4de093eb8e14214f8870 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:52.143244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92af0-4088-41fa-9243-91a6dbc7f8c0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.143627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92af0-4088-41fa-9243-91a6dbc7f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.143930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92af0-4088-41fa-9243-91a6dbc7f8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.148115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1d28c3cb534080a1df499e0bff94c1, user_id=d99a21cd4e7c4d1a86210920ee8f42d5, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.150865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.170507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 846/1681] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:52 2022] PUT /identity/v3/projects/6d1d28c3cb534080a1df499e0bff94c1/users/d99a21cd4e7c4d1a86210920ee8f42d5/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:52.175762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:52.177630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-33d92af0-4088-41fa-9243-91a6dbc7f8c0 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:52.179231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-33d92af0-4088-41fa-9243-91a6dbc7f8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:52.181640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:52.290682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:52.325071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 836/1682] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:52.325619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc23df-cf55-4a6e-a11a-d2ba15da3574 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:52.330744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:52.331505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.331784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.332164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.332955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.334601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.352234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 847/1683] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:52.356807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92af0-4088-41fa-9243-91a6dbc7f8c0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:52.373162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92af0-4088-41fa-9243-91a6dbc7f8c0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:52.380495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:52.382693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b75424-daec-4e02-854f-b293860982eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:52.384125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:52.385914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b75424-daec-4e02-854f-b293860982eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.386187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b75424-daec-4e02-854f-b293860982eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.387014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b75424-daec-4e02-854f-b293860982eb admin admin] PATH_INFO: `/v3/projects/6d1d28c3cb534080a1df499e0bff94c1/users/d99a21cd4e7c4d1a86210920ee8f42d5/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.393728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b75424-daec-4e02-854f-b293860982eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d1d28c3cb534080a1df499e0bff94c1, user_id=d99a21cd4e7c4d1a86210920ee8f42d5, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.396416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b75424-daec-4e02-854f-b293860982eb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.430101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 837/1684] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:52 2022] PUT /identity/v3/projects/6d1d28c3cb534080a1df499e0bff94c1/users/d99a21cd4e7c4d1a86210920ee8f42d5/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:52.443185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.443938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.444869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.523064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] MFA Rules not processed for user `d99a21cd4e7c4d1a86210920ee8f42d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:52.526551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:52.538865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58157a6f-68b8-4527-998e-0fb492e94342 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:52.615788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:52.616261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.616545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.616851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.714822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.716149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 838/1685] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:52.716877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.725814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:52.729854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:52.734676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 848/1686] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:31:52.742378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:52.744357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:52.758796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbcbc4-da24-460e-8ec9-3fe57dda08f5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:52.771336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:52.771918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.772196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.772470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] PATH_INFO: `/v3/projects/1a6baa09da864596b1a2393af5c88cc9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.774473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6baa09da864596b1a2393af5c88cc9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.776332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.783913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:52.821718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce520b-70a6-42d1-a6ed-5153c55f3306 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:52.825896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a511e7-0f7d-436d-b3dd-239b78cb8229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:52.826777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a511e7-0f7d-436d-b3dd-239b78cb8229 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.826930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a511e7-0f7d-436d-b3dd-239b78cb8229 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.827305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a511e7-0f7d-436d-b3dd-239b78cb8229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.838549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:52.843087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a511e7-0f7d-436d-b3dd-239b78cb8229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:52.844581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a511e7-0f7d-436d-b3dd-239b78cb8229 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:52.867003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6baa09da864596b1a2393af5c88cc9', 'request_id': 'req-bd36e21f-de33-4812-a748-7918309146ef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.879807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6baa09da864596b1a2393af5c88cc9', 'request_id': 'req-bd36e21f-de33-4812-a748-7918309146ef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.895706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6baa09da864596b1a2393af5c88cc9', 'request_id': 'req-bd36e21f-de33-4812-a748-7918309146ef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.915303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 849/1687] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:52.921963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] The token cache is being invalidate because project 1a6baa09da864596b1a2393af5c88cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:31:52.922302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.923213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:52.926660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 839/1688] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:31:52 2022] DELETE /identity/v3/projects/1a6baa09da864596b1a2393af5c88cc9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:52.932310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e73922-05c4-4bfc-9653-cb4e426f558c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:52.934526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e73922-05c4-4bfc-9653-cb4e426f558c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:52.937113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e73922-05c4-4bfc-9653-cb4e426f558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:52.971436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-30e73922-05c4-4bfc-9653-cb4e426f558c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:52.974606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-30e73922-05c4-4bfc-9653-cb4e426f558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:53.015662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:53.017365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:53.149724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 850/1689] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:53.151500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3753f-30c7-420d-81a5-dc78f7ce1c58 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.151797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3753f-30c7-420d-81a5-dc78f7ce1c58 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.152070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3753f-30c7-420d-81a5-dc78f7ce1c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.173578 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36e21f-de33-4812-a748-7918309146ef admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:53.184057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dd879-f0e2-4fac-b3ad-e59385493eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:53.184880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd879-f0e2-4fac-b3ad-e59385493eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.185666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd879-f0e2-4fac-b3ad-e59385493eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.185666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd879-f0e2-4fac-b3ad-e59385493eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.191260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9c7dd879-f0e2-4fac-b3ad-e59385493eb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:53.195921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-15a3753f-30c7-420d-81a5-dc78f7ce1c58 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:53.197203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-15a3753f-30c7-420d-81a5-dc78f7ce1c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:53.217021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 851/1690] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:53.217994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3753f-30c7-420d-81a5-dc78f7ce1c58 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:53.239506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3753f-30c7-420d-81a5-dc78f7ce1c58 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:53.261181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:53.262163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.262279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.262520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.263257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:53.263568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:53.265251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:53.299590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 852/1691] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:53.300774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:53.316224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2f7ec-528c-497b-952e-b88bc9cce8d7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:53.329438 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:53.330555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.331111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.332344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.333324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:53.335707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:53.355024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dd879-f0e2-4fac-b3ad-e59385493eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:53.357409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dd879-f0e2-4fac-b3ad-e59385493eb9 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:53.383605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 840/1692] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:53.384910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d845-0d56-4fde-be42-4a0337b64281 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.385192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d845-0d56-4fde-be42-4a0337b64281 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.385464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14d845-0d56-4fde-be42-4a0337b64281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.429721 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2d14d845-0d56-4fde-be42-4a0337b64281 None None] MFA Rules not processed for user `5a17f3ec8f4d43049b61688a0578cd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:53.430948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2d14d845-0d56-4fde-be42-4a0337b64281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:53.439332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 853/1693] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:53 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:53.440304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:53.525254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:53.544503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 841/1694] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:53.692934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ceaf-1ff3-44e5-855a-323361ba8d63 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:53.700378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:53.701147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.701594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.703443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.704427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:53.706577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:53.757651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 854/1695] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:53 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:53.761756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14d845-0d56-4fde-be42-4a0337b64281 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:53.779848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14d845-0d56-4fde-be42-4a0337b64281 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:53.793475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:53.794180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.794460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.794728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.795466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:53.805412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:53.835459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 842/1696] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:31:53.839767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:53.862005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d84f2-26fc-4eee-b92c-b7ccbf86f53b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:53.879463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5156af4-1299-4e6d-b6f3-36e0236438d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:53.881629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5156af4-1299-4e6d-b6f3-36e0236438d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.881875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5156af4-1299-4e6d-b6f3-36e0236438d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.882713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5156af4-1299-4e6d-b6f3-36e0236438d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.883449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5156af4-1299-4e6d-b6f3-36e0236438d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:53.902072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5156af4-1299-4e6d-b6f3-36e0236438d8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:53.939399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 855/1697] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:53.943797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:53.957313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afdf89-a9ba-44ad-8958-328c593ac66e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:53.964203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:53.965395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:53.965752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:53.966095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] PATH_INFO: `/v3/projects/8f9d3000b4144a57ab09a8b185900834/users/703d936b21bb4aabbefcce7c59ffe413/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:53.986060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9d3000b4144a57ab09a8b185900834, user_id=703d936b21bb4aabbefcce7c59ffe413, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:53.989008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.018735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 843/1698] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:53 2022] PUT /identity/v3/projects/8f9d3000b4144a57ab09a8b185900834/users/703d936b21bb4aabbefcce7c59ffe413/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:54.020874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.022015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.022299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.085606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] MFA Rules not processed for user `703d936b21bb4aabbefcce7c59ffe413`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:54.086966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:54.114966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:54.248993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 856/1699] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:54.253843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:54.420144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:54.421636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:54.425965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652db6f-6869-43de-87d5-7896b0061c53 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:54.443409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:54.444541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.444776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8f87c-a92d-4d85-ac58-6af57cba746c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:54.445236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.445691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.446567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:54.448653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.458467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:54.458904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.459192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.459475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] PATH_INFO: `/v3/projects/3efb347e07c548b5bf834bcf6fb257cd` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.463616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efb347e07c548b5bf834bcf6fb257cd)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:54.465662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.493049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 844/1700] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:54 2022] POST /identity/v3/projects => generated 365 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:54.495266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:54.577553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efb347e07c548b5bf834bcf6fb257cd', 'request_id': 'req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:54.580176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24081ae0-1559-498b-9f25-7b1f8b36d43e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:54.591485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efb347e07c548b5bf834bcf6fb257cd', 'request_id': 'req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:54.614956 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efb347e07c548b5bf834bcf6fb257cd', 'request_id': 'req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:54.634260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] The token cache is being invalidate because project 3efb347e07c548b5bf834bcf6fb257cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:31:54.634635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:54.635244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6d05bd6b-8c9a-47f9-a063-8c55a77eab09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:54.640794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 857/1701] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:31:54 2022] DELETE /identity/v3/projects/3efb347e07c548b5bf834bcf6fb257cd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:54.642975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c3a2-b5e0-4df7-989d-f4a4430ca1af None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.643263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c3a2-b5e0-4df7-989d-f4a4430ca1af None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.643582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847c3a2-b5e0-4df7-989d-f4a4430ca1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.659396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:54.683844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:54.684933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.685727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.685854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a847c3a2-b5e0-4df7-989d-f4a4430ca1af None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:54.686398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.687151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a847c3a2-b5e0-4df7-989d-f4a4430ca1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:54.689450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:54.694052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.717653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 858/1702] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:54.726462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c8e7-424c-43e0-9927-f5d4bf7a088e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.727073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c8e7-424c-43e0-9927-f5d4bf7a088e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.727557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c8e7-424c-43e0-9927-f5d4bf7a088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.730860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 845/1703] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:54 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:54.735258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:54.746752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:54.764479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-35c5c8e7-424c-43e0-9927-f5d4bf7a088e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:54.769512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-35c5c8e7-424c-43e0-9927-f5d4bf7a088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:54.770497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a3c46-1fc2-4d4f-a85e-d09bb8c66a34 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:54.778868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:54.779592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.780000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.783522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.786301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:54.790683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.792324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 859/1704] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:31:54.798432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c8e7-424c-43e0-9927-f5d4bf7a088e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:54.819509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c8e7-424c-43e0-9927-f5d4bf7a088e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:54.821102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 846/1705] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:54.827474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:54.828651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:54.838690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:54.839733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.840223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.840810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.841748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:54.842238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:54.844042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.848255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b384d57-7727-4251-8e54-eb9447378678 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:54.854424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:54.856112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.856669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.856983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] PATH_INFO: `/v3/projects/c2d9ba08e42b48fa9d6e9f61bcc4a1c5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.858505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d9ba08e42b48fa9d6e9f61bcc4a1c5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:54.860893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.879351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 860/1706] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:54.880850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:54.903316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1440b8-c028-4d7c-b85e-0949f2d8b2a0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:54.920704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df743fc3-145b-4dea-b0aa-8987700785b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:54.922291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743fc3-145b-4dea-b0aa-8987700785b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:54.922689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743fc3-145b-4dea-b0aa-8987700785b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:54.923036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df743fc3-145b-4dea-b0aa-8987700785b2 admin admin] PATH_INFO: `/v3/projects/e0a7f5028abc4e5cb2e43b7427e6917a/users/a68ee1a9ef654647b88edfb7bc76dddc/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:54.961456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743fc3-145b-4dea-b0aa-8987700785b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a7f5028abc4e5cb2e43b7427e6917a, user_id=a68ee1a9ef654647b88edfb7bc76dddc, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:54.966057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df743fc3-145b-4dea-b0aa-8987700785b2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:54.984163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d9ba08e42b48fa9d6e9f61bcc4a1c5', 'request_id': 'req-e189235e-65f0-417c-87c5-60c5d74f4e93'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:54.997003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d9ba08e42b48fa9d6e9f61bcc4a1c5', 'request_id': 'req-e189235e-65f0-417c-87c5-60c5d74f4e93'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.005557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 861/1707] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:54 2022] PUT /identity/v3/projects/e0a7f5028abc4e5cb2e43b7427e6917a/users/a68ee1a9ef654647b88edfb7bc76dddc/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:55.007280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046dc6-43e4-47bb-8367-607a5903ef00 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:55.007791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046dc6-43e4-47bb-8367-607a5903ef00 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:55.008260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046dc6-43e4-47bb-8367-607a5903ef00 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:55.013136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 862/1708] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jun 23 11:31:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:31:55.014043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d9ba08e42b48fa9d6e9f61bcc4a1c5', 'request_id': 'req-e189235e-65f0-417c-87c5-60c5d74f4e93'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.015110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b046dc6-43e4-47bb-8367-607a5903ef00 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:55.060019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] The token cache is being invalidate because project c2d9ba08e42b48fa9d6e9f61bcc4a1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:31:55.060318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.061088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.063994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 847/1709] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:31:54 2022] DELETE /identity/v3/projects/c2d9ba08e42b48fa9d6e9f61bcc4a1c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:55.065301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:55.067825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:55.145618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:55.168213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b046dc6-43e4-47bb-8367-607a5903ef00 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:55.182236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc75246-4706-4c9b-863d-877b8235261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:55.182951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc75246-4706-4c9b-863d-877b8235261b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:55.183229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc75246-4706-4c9b-863d-877b8235261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:55.183498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc75246-4706-4c9b-863d-877b8235261b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:55.184211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc75246-4706-4c9b-863d-877b8235261b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:55.186185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc75246-4706-4c9b-863d-877b8235261b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:55.254040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 863/1710] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:55 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:55.256319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:55.256937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:55.259552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:55.271612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189235e-65f0-417c-87c5-60c5d74f4e93 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:55.350525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] MFA Rules not processed for user `795571c4c2cc4f969ce487c0ec6dfbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:55.352183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:55.427524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:55.429001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:55.429417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:55.429822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:55.430715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:55.432492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:55.437135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:55.458684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 848/1711] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:55.462263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:55.466614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:55.481927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 864/1712] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:55.483754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:55.486575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:55.492922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7428c30-1080-4dd1-8642-5359c1d5e1da admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:55.508756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:55.510005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:55.510529 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:55.510999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] PATH_INFO: `/v3/users/df5fa29f076e42cfa4b608265da4a6a5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:55.514568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5fa29f076e42cfa4b608265da4a6a5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:55.517563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc3318-62f1-44b7-8e3f-db017c41b9f5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:55.520441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:55.530622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:55.533362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:55.533853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:55.535671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:55.538013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:55.547274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:55.594233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 865/1713] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:55 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:55.595790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:55.621621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d8bbf-7136-4cb4-ae04-9f990e6bd1bd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:55.649834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5fa29f076e42cfa4b608265da4a6a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.656223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:55.657186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:55.657466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:55.657739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] PATH_INFO: `/v3/projects/e0a7f5028abc4e5cb2e43b7427e6917a/users/a68ee1a9ef654647b88edfb7bc76dddc/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:55.667831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a7f5028abc4e5cb2e43b7427e6917a, user_id=a68ee1a9ef654647b88edfb7bc76dddc, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:55.672092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:55.679105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5fa29f076e42cfa4b608265da4a6a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.680344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5fa29f076e42cfa4b608265da4a6a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.681120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5fa29f076e42cfa4b608265da4a6a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.708701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 866/1714] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:55 2022] PUT /identity/v3/projects/e0a7f5028abc4e5cb2e43b7427e6917a/users/a68ee1a9ef654647b88edfb7bc76dddc/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:55.722872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:55.726263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5fa29f076e42cfa4b608265da4a6a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:55.727260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:55.759304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 849/1715] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:55 2022] DELETE /identity/v3/users/df5fa29f076e42cfa4b608265da4a6a5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:55.762118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:55.763781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:55.982819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cee41-c553-4ac7-8af7-c6eab220a0c3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:56.031669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2cfca-0ed3-46b4-af8b-c7157b639265 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:56.047715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdfe89-3e7e-4044-993e-717573b1261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:56.051675 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdfe89-3e7e-4044-993e-717573b1261a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.053437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdfe89-3e7e-4044-993e-717573b1261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.053867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdfe89-3e7e-4044-993e-717573b1261a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.054805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdfe89-3e7e-4044-993e-717573b1261a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:56.056595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdfe89-3e7e-4044-993e-717573b1261a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:56.080778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 850/1716] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:56.082546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.089486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.089988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.132796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] MFA Rules not processed for user `a68ee1a9ef654647b88edfb7bc76dddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:56.134023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:56.174987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:56.178511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.179248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.179696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.182644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:56.205518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:56.207927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:56.220474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 867/1717] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:56.221838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:56.235039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:56.249523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e633ed6-8a28-4732-9c47-653b63291b00 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:56.260948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:56.263284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.263827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.264069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.272476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:56.274547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:56.288620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:56.294578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 868/1718] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:56.295791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:56.308231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b388d-7602-4176-b3dd-6092d0e023f2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:56.314236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad9f1-95ea-49a8-b927-24b9bcbc76e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:56.318683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad9f1-95ea-49a8-b927-24b9bcbc76e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.319778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad9f1-95ea-49a8-b927-24b9bcbc76e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.320079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad9f1-95ea-49a8-b927-24b9bcbc76e6 admin admin] PATH_INFO: `/v3/projects/d82a70b3f646446b8ace26b0c22e0ba9/users/62d9f7eba25043c0b18c0409561e2075/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.369074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 851/1719] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:56.381313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:56.383713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:56.389666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad9f1-95ea-49a8-b927-24b9bcbc76e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82a70b3f646446b8ace26b0c22e0ba9, user_id=62d9f7eba25043c0b18c0409561e2075, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:56.396431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad9f1-95ea-49a8-b927-24b9bcbc76e6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:56.450062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 869/1720] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:56 2022] PUT /identity/v3/projects/d82a70b3f646446b8ace26b0c22e0ba9/users/62d9f7eba25043c0b18c0409561e2075/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:56.461679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4a7e-eaa2-4aaa-903a-75422692a2cf None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.462070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4a7e-eaa2-4aaa-903a-75422692a2cf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.462576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4a7e-eaa2-4aaa-903a-75422692a2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.518196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9aaa4a7e-eaa2-4aaa-903a-75422692a2cf None None] MFA Rules not processed for user `62d9f7eba25043c0b18c0409561e2075`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:56.519682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9aaa4a7e-eaa2-4aaa-903a-75422692a2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:56.624389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f000f-cba5-4bf3-b4aa-c515d05a51c7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:56.670639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 870/1721] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:31:56.675753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.675753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.675753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.726679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] MFA Rules not processed for user `1903cd549e764595b2a1be04487f96eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:56.728131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:56.760907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bef65-6a03-4bb0-af4e-ff4adea69b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:56.761661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bef65-6a03-4bb0-af4e-ff4adea69b47 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.761943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bef65-6a03-4bb0-af4e-ff4adea69b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.762215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bef65-6a03-4bb0-af4e-ff4adea69b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:56.887709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 871/1722] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:56.888915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:56.898076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:56.945230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bef65-6a03-4bb0-af4e-ff4adea69b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:56.946759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bef65-6a03-4bb0-af4e-ff4adea69b47 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:56.965994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 852/1723] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:56.975001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4de8-bdfd-4fbb-aabd-d75396fe5ee9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:56.975295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4de8-bdfd-4fbb-aabd-d75396fe5ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:56.975575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea4de8-bdfd-4fbb-aabd-d75396fe5ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:57.028100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-13ea4de8-bdfd-4fbb-aabd-d75396fe5ee9 None None] MFA Rules not processed for user `1903cd549e764595b2a1be04487f96eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:57.032675 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-13ea4de8-bdfd-4fbb-aabd-d75396fe5ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:57.058106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:57.060621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 853/1724] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:57.157328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee303dd-8eec-43cf-b996-9bc924a2d6c4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:57.172686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:57.175427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:57.178011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:57.179588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:57.209867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:57.218151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:57.287166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 872/1725] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:57.332477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea4de8-bdfd-4fbb-aabd-d75396fe5ee9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:57.362974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:57.364521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:57.366806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea4de8-bdfd-4fbb-aabd-d75396fe5ee9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:57.391290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d6a32-046d-4de7-992a-06d7fa0c3252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:57.391980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6a32-046d-4de7-992a-06d7fa0c3252 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:57.392260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6a32-046d-4de7-992a-06d7fa0c3252 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:57.392534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d6a32-046d-4de7-992a-06d7fa0c3252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:57.452058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d6a32-046d-4de7-992a-06d7fa0c3252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:57.453656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d6a32-046d-4de7-992a-06d7fa0c3252 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:57.482432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 854/1726] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:57.662406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e8250-7ebe-4774-8e5b-e33799942ce4 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:57.681342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:57.682396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:57.682646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:57.682802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] PATH_INFO: `/v3/projects/8f25700b0f1f4fa092a8e8c6ffce4ec4` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:57.689680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f25700b0f1f4fa092a8e8c6ffce4ec4)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:57.694242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:57.835287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f25700b0f1f4fa092a8e8c6ffce4ec4', 'request_id': 'req-0c147edb-3883-4c2d-810f-72245e491b56'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:57.844646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f25700b0f1f4fa092a8e8c6ffce4ec4', 'request_id': 'req-0c147edb-3883-4c2d-810f-72245e491b56'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:57.859564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f25700b0f1f4fa092a8e8c6ffce4ec4', 'request_id': 'req-0c147edb-3883-4c2d-810f-72245e491b56'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:57.888691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] The token cache is being invalidate because project 8f25700b0f1f4fa092a8e8c6ffce4ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:31:57.889106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:57.890655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0c147edb-3883-4c2d-810f-72245e491b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:57.897541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 873/1727] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:31:57 2022] DELETE /identity/v3/projects/8f25700b0f1f4fa092a8e8c6ffce4ec4 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:57.898449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77953-f39f-420d-9c03-0f72dcc6260b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:57.898896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77953-f39f-420d-9c03-0f72dcc6260b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:57.899163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77953-f39f-420d-9c03-0f72dcc6260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:57.899426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:57.899813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:57.900194 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:57.944553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] MFA Rules not processed for user `f96e6bc11a9a4693955dea424e969e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:57.946502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:57.972517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-41c77953-f39f-420d-9c03-0f72dcc6260b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:57.975705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-41c77953-f39f-420d-9c03-0f72dcc6260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.015778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:58.069064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 874/1728] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:58.070146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:58.073594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.086591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:58.158286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 855/1729] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:58.160047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500799e-5261-4a7d-923e-4d42e850974b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.160231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500799e-5261-4a7d-923e-4d42e850974b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.160507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500799e-5261-4a7d-923e-4d42e850974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.202823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44962a0-2099-4225-92b7-a090ad82431c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:58.204905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2500799e-5261-4a7d-923e-4d42e850974b None None] MFA Rules not processed for user `f96e6bc11a9a4693955dea424e969e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:58.206335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2500799e-5261-4a7d-923e-4d42e850974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.213641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:58.215806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.216249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.216842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] PATH_INFO: `/v3/users/703d936b21bb4aabbefcce7c59ffe413` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.219298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=703d936b21bb4aabbefcce7c59ffe413)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:58.221739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:58.222972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 856/1730] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:58.224287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c333d42-8344-445a-aaab-e60e345e7388 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.224570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c333d42-8344-445a-aaab-e60e345e7388 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.224871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c333d42-8344-445a-aaab-e60e345e7388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.263350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4c333d42-8344-445a-aaab-e60e345e7388 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:58.264117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c333d42-8344-445a-aaab-e60e345e7388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.273876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 857/1731] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:58.278598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c333d42-8344-445a-aaab-e60e345e7388 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:58.289980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c333d42-8344-445a-aaab-e60e345e7388 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:58.296224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:58.297655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.297986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.298386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.299138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:31:58.299443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:58.301592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:58.319471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 858/1732] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:31:58.325013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:58.329477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '703d936b21bb4aabbefcce7c59ffe413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:58.338370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '703d936b21bb4aabbefcce7c59ffe413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:58.340036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '703d936b21bb4aabbefcce7c59ffe413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:58.341503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '703d936b21bb4aabbefcce7c59ffe413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:58.355037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4ae6c-75f3-4ceb-8768-de221dd6d1a8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:58.382277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce67d4-6d33-4aaf-aaa4-f7522b95236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:58.388535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce67d4-6d33-4aaf-aaa4-f7522b95236e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.388845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce67d4-6d33-4aaf-aaa4-f7522b95236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.389129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce67d4-6d33-4aaf-aaa4-f7522b95236e admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.389844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce67d4-6d33-4aaf-aaa4-f7522b95236e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:58.394459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce67d4-6d33-4aaf-aaa4-f7522b95236e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:58.401103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '703d936b21bb4aabbefcce7c59ffe413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:58.455184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 875/1733] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:58 2022] DELETE /identity/v3/users/703d936b21bb4aabbefcce7c59ffe413 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:58.455184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:58.456268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.498798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 859/1734] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:58 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:58.503632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80156624-aad0-41d1-b490-bfee91e5efc4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.503907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80156624-aad0-41d1-b490-bfee91e5efc4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.504191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80156624-aad0-41d1-b490-bfee91e5efc4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.507408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 860/1735] 10.222.0.66 () {54 vars in 912 bytes} [Thu Jun 23 11:31:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:31:58.514373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.514685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.514967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.564510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:58.567381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.684009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cab29-4dfe-417a-ae6a-944ffb07f3d8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:58.702534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 861/1736] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:58.703497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:58.704794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:58.707271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.735004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d659b-7c01-432d-b4b2-55a40b9095d8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:58.743995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11277d8c-0ce2-43b5-9b4f-de16e0a1e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:58.744890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277d8c-0ce2-43b5-9b4f-de16e0a1e829 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.745027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277d8c-0ce2-43b5-9b4f-de16e0a1e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.748649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277d8c-0ce2-43b5-9b4f-de16e0a1e829 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.749510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11277d8c-0ce2-43b5-9b4f-de16e0a1e829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:58.751865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11277d8c-0ce2-43b5-9b4f-de16e0a1e829 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:58.788781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 862/1737] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:31:58 2022] POST /identity/v3/users => generated 284 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:31:58.791581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8ae26-34f8-4260-be98-3b7ea4420eb7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.792234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8ae26-34f8-4260-be98-3b7ea4420eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.792912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8ae26-34f8-4260-be98-3b7ea4420eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.836248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-34e8ae26-34f8-4260-be98-3b7ea4420eb7 None None] MFA Rules not processed for user `795571c4c2cc4f969ce487c0ec6dfbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:58.837672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-34e8ae26-34f8-4260-be98-3b7ea4420eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.874192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:58.876958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.878488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.879413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.884098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.925421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 863/1738] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:31:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:58.928090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b267-cd6f-4a5b-a4e1-c832d3e67fe3 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.928705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b267-cd6f-4a5b-a4e1-c832d3e67fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.929150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988b267-cd6f-4a5b-a4e1-c832d3e67fe3 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.931478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 864/1739] 10.222.0.66 () {54 vars in 960 bytes} [Thu Jun 23 11:31:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:31:58.932241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b267-cd6f-4a5b-a4e1-c832d3e67fe3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:58.933982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1988b267-cd6f-4a5b-a4e1-c832d3e67fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:58.953451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988b267-cd6f-4a5b-a4e1-c832d3e67fe3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:58.959773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:58.960450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:58.960752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:58.961054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:58.992175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:58.993698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.017970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 865/1740] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:59.019278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:59.052652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d5657-11d2-4461-90d7-7ac8d6c60c11 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:59.066844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb3bf8-209d-4484-9861-7010654688ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:59.068671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb3bf8-209d-4484-9861-7010654688ec admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.069266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb3bf8-209d-4484-9861-7010654688ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.070974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb3bf8-209d-4484-9861-7010654688ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.072365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb3bf8-209d-4484-9861-7010654688ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:59.079481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb3bf8-209d-4484-9861-7010654688ec admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.081282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:59.101586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:59.107232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.113132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 866/1741] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:59.116963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f6b67-e3ed-44ed-a85c-628fa49cbba6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.118595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f6b67-e3ed-44ed-a85c-628fa49cbba6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.119007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f6b67-e3ed-44ed-a85c-628fa49cbba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.137814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 876/1742] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:59.152577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:59.162985 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:59.199420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-323f6b67-e3ed-44ed-a85c-628fa49cbba6 None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:59.203019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-323f6b67-e3ed-44ed-a85c-628fa49cbba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:59.205777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5ea14-83f5-467a-bb02-fdf3ecb8c5dd service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:59.214832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:59.215514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.215795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.216070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.228983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:59.230615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.250524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 877/1743] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:59.251304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:59.254555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:59.296245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e86ce-d512-4b8b-b7c1-d78615a4fde8 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:59.303411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:59.304318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.304592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.305810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] PATH_INFO: `/v3/users/2eaa5d9c3dcd4ab4bb10e799f7e83e7b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.307708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eaa5d9c3dcd4ab4bb10e799f7e83e7b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:59.309295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.371304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 867/1744] 10.222.0.66 () {58 vars in 1057 bytes} [Thu Jun 23 11:31:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:31:59.372560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f6b67-e3ed-44ed-a85c-628fa49cbba6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:59.385284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f6b67-e3ed-44ed-a85c-628fa49cbba6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:59.391421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:59.393639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.395757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.396221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.397612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:59.399930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.428678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 868/1745] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:31:59.430337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:59.449205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bce865-53ab-479e-baec-06741988c456 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:59.458804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:59.460979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.461482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.462060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.464584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:59.484411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:59.486526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.502666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 869/1746] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:31:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:31:59.503896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:59.517088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44151be-204d-451d-a545-9afb272d6175 service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:31:59.523914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4aa48-a279-4c1e-b4ae-170026f8d92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:31:59.525546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4aa48-a279-4c1e-b4ae-170026f8d92d admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.525954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4aa48-a279-4c1e-b4ae-170026f8d92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.526326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4aa48-a279-4c1e-b4ae-170026f8d92d admin admin] PATH_INFO: `/v3/projects/3630731d86714bb0a2995446facd560e/users/54a9a17d8be24fb793bc0eb423a7f0dc/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.554654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4aa48-a279-4c1e-b4ae-170026f8d92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3630731d86714bb0a2995446facd560e, user_id=54a9a17d8be24fb793bc0eb423a7f0dc, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:31:59.557989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4aa48-a279-4c1e-b4ae-170026f8d92d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:31:59.599974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 870/1747] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:31:59 2022] PUT /identity/v3/projects/3630731d86714bb0a2995446facd560e/users/54a9a17d8be24fb793bc0eb423a7f0dc/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:59.610580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.611320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.611849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.684925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] MFA Rules not processed for user `54a9a17d8be24fb793bc0eb423a7f0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:59.686570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:59.754356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eaa5d9c3dcd4ab4bb10e799f7e83e7b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:59.762967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eaa5d9c3dcd4ab4bb10e799f7e83e7b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:59.763809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eaa5d9c3dcd4ab4bb10e799f7e83e7b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:59.764527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eaa5d9c3dcd4ab4bb10e799f7e83e7b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:59.779548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f8def61c-10fa-43cf-b8b2-8e32559165f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eaa5d9c3dcd4ab4bb10e799f7e83e7b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:31:59.804803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 871/1748] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:31:59.806766 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 878/1749] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:31:59 2022] DELETE /identity/v3/users/2eaa5d9c3dcd4ab4bb10e799f7e83e7b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:31:59.808546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:31:59.811863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:59.812423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:31:59.814107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:31:59.814747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:31:59.833947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:59.865799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:31:59.869300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:31:59.905908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:31:59.952013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6dcdb-36b9-4764-9741-78e9c02bb596 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:00.031253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 879/1750] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:00.045016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:00.052690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:00.058486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:00.059182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:00.060064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:00.060064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:00.060799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:00.069929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:00.130210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 872/1751] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:31:59 2022] POST /identity/v3/projects => generated 367 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:00.135989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:00.291714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811b8db-af20-48e2-ad20-d719a8d27437 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:00.346396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582738-0453-4cc1-ab9c-950db2751fbd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:00.374075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:00.375901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:00.376229 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:00.376455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:00.377242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:00.379361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:00.457307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 873/1752] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:00 2022] POST /identity/v3/users => generated 290 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:00.458620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:00.487457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:00.488251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:00.490027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:00.501173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2d720-099a-4c84-a18f-ec06138b917b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:00.510354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:00.526371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:00.527078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:00.527362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:00.527632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:00.528380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:00.542632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:00.569281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:00.570770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:00.577825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 874/1753] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:00.580356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:00.615913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aad611-1284-4206-9a64-f7ea08adac70 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:00.643220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:00.644620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:00.646570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 880/1754] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:00.650330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:00.650674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] PATH_INFO: `/v3/projects/b57b34306e3042c1b4e29112c874eb5a/users/37913a53226c410eb8bc25ac87fbb811/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:00.720376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57b34306e3042c1b4e29112c874eb5a, user_id=37913a53226c410eb8bc25ac87fbb811, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:00.731908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:00.779749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 875/1755] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:00 2022] PUT /identity/v3/projects/b57b34306e3042c1b4e29112c874eb5a/users/37913a53226c410eb8bc25ac87fbb811/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:00.784008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:00.819232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291e1dc-b22d-4022-abe6-9c5c2885bbb2 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:00.880625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:00.882364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:00.950500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:01.058535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:01.059707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.060078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.060445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.061305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:01.067981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:01.084891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa5a3b-6f6e-4107-aa12-f8f2bf1fa8e6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:01.089280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:01.099726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:01.100635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.100948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.101307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] PATH_INFO: `/v3/projects/8f9d3000b4144a57ab09a8b185900834` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.105692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9d3000b4144a57ab09a8b185900834)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:01.108027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:01.115046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 881/1756] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:01.116052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:01.139439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8d3a4-a3ce-48c5-a8eb-e204d30c59a4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:01.149127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b30e8-7532-453d-9959-91f31860ce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:01.150385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b30e8-7532-453d-9959-91f31860ce56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.150811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b30e8-7532-453d-9959-91f31860ce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.151603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b30e8-7532-453d-9959-91f31860ce56 admin admin] PATH_INFO: `/v3/projects/b57b34306e3042c1b4e29112c874eb5a/users/37913a53226c410eb8bc25ac87fbb811/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.153798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b30e8-7532-453d-9959-91f31860ce56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57b34306e3042c1b4e29112c874eb5a, user_id=37913a53226c410eb8bc25ac87fbb811, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:01.157733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b30e8-7532-453d-9959-91f31860ce56 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:01.182436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 882/1757] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:01 2022] PUT /identity/v3/projects/b57b34306e3042c1b4e29112c874eb5a/users/37913a53226c410eb8bc25ac87fbb811/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:01.189435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.189935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.190439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.227334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9d3000b4144a57ab09a8b185900834', 'request_id': 'req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.247206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9d3000b4144a57ab09a8b185900834', 'request_id': 'req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.269243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9d3000b4144a57ab09a8b185900834', 'request_id': 'req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.298154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] The token cache is being invalidate because project 8f9d3000b4144a57ab09a8b185900834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:01.298451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.299145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.305145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 876/1758] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:00 2022] DELETE /identity/v3/projects/8f9d3000b4144a57ab09a8b185900834 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:01.313832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:01.315333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:01.332440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] MFA Rules not processed for user `37913a53226c410eb8bc25ac87fbb811`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:01.342931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:01.513638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842d72e-5821-4a2c-bc43-3ca2a3b723eb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:01.528847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:01.529696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.529982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.530262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] PATH_INFO: `/v3/users/a68ee1a9ef654647b88edfb7bc76dddc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.536216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68ee1a9ef654647b88edfb7bc76dddc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:01.538259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:01.575661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 883/1759] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:01.576930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:01.579335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:01.615663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68ee1a9ef654647b88edfb7bc76dddc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.618049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1c569-4ef3-4456-8cb2-475abce31155 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:01.622794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:01.626385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68ee1a9ef654647b88edfb7bc76dddc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.633246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68ee1a9ef654647b88edfb7bc76dddc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.634780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68ee1a9ef654647b88edfb7bc76dddc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.639526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:01.641792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.642082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.644849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] PATH_INFO: `/v3/users/62d9f7eba25043c0b18c0409561e2075` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.649062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d9f7eba25043c0b18c0409561e2075)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:01.653964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68ee1a9ef654647b88edfb7bc76dddc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.657221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:01.700559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 877/1760] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:01 2022] DELETE /identity/v3/users/a68ee1a9ef654647b88edfb7bc76dddc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:01.700559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:01.703049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:01.802497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d9f7eba25043c0b18c0409561e2075'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.832376 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e8d8f-b695-4894-abf2-e5cd21364267 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:01.833419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d9f7eba25043c0b18c0409561e2075'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.835483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d9f7eba25043c0b18c0409561e2075'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.837528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d9f7eba25043c0b18c0409561e2075'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.841222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:01.841935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.842219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.842495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.850752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:01.887287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1365564d-3dc2-4d82-9934-1f007ef23f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d9f7eba25043c0b18c0409561e2075'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:01.912532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 884/1761] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:01 2022] DELETE /identity/v3/users/62d9f7eba25043c0b18c0409561e2075 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:01.928216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee5af-b646-46ad-b9c6-453ff0a8f849 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:01.928769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee5af-b646-46ad-b9c6-453ff0a8f849 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:01.929195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ee5af-b646-46ad-b9c6-453ff0a8f849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:01.956140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:01.957793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:01.983903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 878/1762] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:01.993086 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cd3ee5af-b646-46ad-b9c6-453ff0a8f849 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:01.994562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cd3ee5af-b646-46ad-b9c6-453ff0a8f849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:02.158866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:02.257082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 885/1763] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:02.286644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:02.288400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:02.532741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71d337-259b-4ab2-a1ba-0752abe11686 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:02.646046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:02.682538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:02.683085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:02.683836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:02.706237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:02.726847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:02.727177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:02.728240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:02.798919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:02.809066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:02.813427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] MFA Rules not processed for user `73c9e36a6c5f4bc8962ef86d39c496cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:02.819596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:02.866486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 879/1764] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:02.870045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:02.877513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:02.932740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562c112-b127-4a57-a8a3-58a056d65b78 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:02.953065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:02.955561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:02.955951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:02.956401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] PATH_INFO: `/v3/projects/21b3293632054bf5bb43eae1b96c876e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:02.964363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b3293632054bf5bb43eae1b96c876e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:02.967284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:03.132895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 886/1765] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:03.137326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:03.145579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:03.181428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b3293632054bf5bb43eae1b96c876e', 'request_id': 'req-303eb414-0ae8-46f1-80c3-b0059fcc3f06'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.211795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdec32a-1ee9-4597-8aa7-a89d215771a9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:03.213231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b3293632054bf5bb43eae1b96c876e', 'request_id': 'req-303eb414-0ae8-46f1-80c3-b0059fcc3f06'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.239614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b3293632054bf5bb43eae1b96c876e', 'request_id': 'req-303eb414-0ae8-46f1-80c3-b0059fcc3f06'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.283713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] The token cache is being invalidate because project 21b3293632054bf5bb43eae1b96c876e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:03.284387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.286323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.296617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 880/1766] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:02 2022] DELETE /identity/v3/projects/21b3293632054bf5bb43eae1b96c876e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:03.302592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:03.308242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:03.500166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:03.504429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:03.504736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:03.508805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] PATH_INFO: `/v3/projects/e0a7f5028abc4e5cb2e43b7427e6917a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:03.515325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a7f5028abc4e5cb2e43b7427e6917a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:03.518264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:03.653433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eb414-0ae8-46f1-80c3-b0059fcc3f06 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:03.687896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:03.688615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:03.688928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:03.689229 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:03.708953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:03.746268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a7f5028abc4e5cb2e43b7427e6917a', 'request_id': 'req-41144711-136e-40f1-8d27-9211eee07c3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.766162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a7f5028abc4e5cb2e43b7427e6917a', 'request_id': 'req-41144711-136e-40f1-8d27-9211eee07c3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.791636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a7f5028abc4e5cb2e43b7427e6917a', 'request_id': 'req-41144711-136e-40f1-8d27-9211eee07c3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.824481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] The token cache is being invalidate because project e0a7f5028abc4e5cb2e43b7427e6917a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:03.825100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.830017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-41144711-136e-40f1-8d27-9211eee07c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:03.832511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 887/1767] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:03 2022] DELETE /identity/v3/projects/e0a7f5028abc4e5cb2e43b7427e6917a => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:03.836478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:03.836796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:03.837116 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:03.870306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:03.914640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] MFA Rules not processed for user `f96e6bc11a9a4693955dea424e969e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:03.915863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:03.962684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:03.973045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:03.979579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:04.001885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 881/1768] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:04.005357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:04.010554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:04.040449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c15216-e100-4127-86e9-afa4da719764 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:04.160647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 888/1769] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:04.162353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:04.167566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:04.270494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:04.277113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:04.277747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:04.278120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] PATH_INFO: `/v3/users/d99a21cd4e7c4d1a86210920ee8f42d5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:04.279928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d99a21cd4e7c4d1a86210920ee8f42d5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:04.295556 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:04.443248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd99a21cd4e7c4d1a86210920ee8f42d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.464407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd99a21cd4e7c4d1a86210920ee8f42d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.465373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd99a21cd4e7c4d1a86210920ee8f42d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.467782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd99a21cd4e7c4d1a86210920ee8f42d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.494743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef76baec-8ffc-4897-bef3-89eb46d2e940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd99a21cd4e7c4d1a86210920ee8f42d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.528668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 882/1770] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:04 2022] DELETE /identity/v3/users/d99a21cd4e7c4d1a86210920ee8f42d5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:04.530243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14853a4b-8083-4960-bf1c-5ff175c71a2d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:04.530616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14853a4b-8083-4960-bf1c-5ff175c71a2d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:04.530801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14853a4b-8083-4960-bf1c-5ff175c71a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:04.562363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992e885-9a47-4ed1-87b8-8f4395fc81e9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:04.588015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-14853a4b-8083-4960-bf1c-5ff175c71a2d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:04.589784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-14853a4b-8083-4960-bf1c-5ff175c71a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:04.732091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 883/1771] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:04.733485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f63c3-aedb-4d45-aeac-f96c6ec43c57 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:04.733779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f63c3-aedb-4d45-aeac-f96c6ec43c57 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:04.734061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f63c3-aedb-4d45-aeac-f96c6ec43c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:04.778434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:04.779380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:04.779665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:04.779941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] PATH_INFO: `/v3/projects/d82a70b3f646446b8ace26b0c22e0ba9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:04.781288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82a70b3f646446b8ace26b0c22e0ba9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:04.781792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-113f63c3-aedb-4d45-aeac-f96c6ec43c57 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:04.783031 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-113f63c3-aedb-4d45-aeac-f96c6ec43c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:04.783500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:04.808897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:04.889238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82a70b3f646446b8ace26b0c22e0ba9', 'request_id': 'req-abb218ab-c056-4814-a6e0-f2b217d8cd62'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.896530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 884/1772] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:04.897985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93cce-5420-480a-a0a6-b0666de29ce4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:04.898273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93cce-5420-480a-a0a6-b0666de29ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:04.898554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93cce-5420-480a-a0a6-b0666de29ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:04.900694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82a70b3f646446b8ace26b0c22e0ba9', 'request_id': 'req-abb218ab-c056-4814-a6e0-f2b217d8cd62'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.905802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:04.921019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82a70b3f646446b8ace26b0c22e0ba9', 'request_id': 'req-abb218ab-c056-4814-a6e0-f2b217d8cd62'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.947112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] The token cache is being invalidate because project d82a70b3f646446b8ace26b0c22e0ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:04.947411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.948614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-abb218ab-c056-4814-a6e0-f2b217d8cd62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:04.949942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9ba93cce-5420-480a-a0a6-b0666de29ce4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:04.950839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9ba93cce-5420-480a-a0a6-b0666de29ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:04.956889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 889/1773] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:04 2022] DELETE /identity/v3/projects/d82a70b3f646446b8ace26b0c22e0ba9 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:04.957934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cf6e-5134-491a-95fd-d24a3c05a411 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:04.958471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cf6e-5134-491a-95fd-d24a3c05a411 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:04.958774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7cf6e-5134-491a-95fd-d24a3c05a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.007832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8df7cf6e-5134-491a-95fd-d24a3c05a411 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:05.011686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8df7cf6e-5134-491a-95fd-d24a3c05a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:05.142395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 885/1774] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:05.147596 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba93cce-5420-480a-a0a6-b0666de29ce4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.170227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba93cce-5420-480a-a0a6-b0666de29ce4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:05.191885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfe33f-fe88-4654-a303-e05dd0a5d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:05.194202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfe33f-fe88-4654-a303-e05dd0a5d8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.194488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfe33f-fe88-4654-a303-e05dd0a5d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.208252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfe33f-fe88-4654-a303-e05dd0a5d8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.209037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfe33f-fe88-4654-a303-e05dd0a5d8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:05.209387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfe33f-fe88-4654-a303-e05dd0a5d8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:05.211055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfe33f-fe88-4654-a303-e05dd0a5d8d2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:05.233547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 890/1775] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:05.237224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 886/1776] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:05.238432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7cf6e-5134-491a-95fd-d24a3c05a411 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.238734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738169-0050-49d5-801b-e0046892d0ab None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.239023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738169-0050-49d5-801b-e0046892d0ab None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.239351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738169-0050-49d5-801b-e0046892d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.255991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7cf6e-5134-491a-95fd-d24a3c05a411 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:05.272457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:05.273181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.273469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.273764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.274972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:05.281511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-85738169-0050-49d5-801b-e0046892d0ab None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:05.282714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-85738169-0050-49d5-801b-e0046892d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:05.288832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:05.296171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 887/1777] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:05.297139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85738169-0050-49d5-801b-e0046892d0ab None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.298699 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-85738169-0050-49d5-801b-e0046892d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:05.344384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 891/1778] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:05 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:05.344384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.481568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bee5a0-a2dd-445e-9652-4c0c0dca32d2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:05.499030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85738169-0050-49d5-801b-e0046892d0ab None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:05.515160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:05.516176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.516461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.516801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.517545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:05.517864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:05.519878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:05.567603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 892/1779] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:05.568887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.595175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae607d6e-d702-40e2-bbca-63a2a28477c3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:05.599041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:05.624581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:05.625341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.625638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.626071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.627155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:05.629946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:05.639632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:05.640317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.641635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.641635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.644773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:05.680264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 893/1780] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:05 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:05.681241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.693513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:05.730939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52b8c1-e762-4e8d-989f-7433ac326fec admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:05.758760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:05.759680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.759960 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.760233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] PATH_INFO: `/v3/users/54a9a17d8be24fb793bc0eb423a7f0dc` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.762073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a9a17d8be24fb793bc0eb423a7f0dc)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:05.764025 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:05.829844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:05.834330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:05.851063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:05.863480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 888/1781] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:32:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:32:05.864125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.865513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a9a17d8be24fb793bc0eb423a7f0dc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:05.883792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a9a17d8be24fb793bc0eb423a7f0dc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:05.884949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a9a17d8be24fb793bc0eb423a7f0dc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:05.885795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a9a17d8be24fb793bc0eb423a7f0dc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:05.886747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b79f15-02a7-4dfd-88c6-a80bd43e235e service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:05.892038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2809997-477a-4f26-a2f3-9c43e2e9413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:05.892887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809997-477a-4f26-a2f3-9c43e2e9413e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:05.893034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809997-477a-4f26-a2f3-9c43e2e9413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:05.893346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2809997-477a-4f26-a2f3-9c43e2e9413e admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:05.894707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2809997-477a-4f26-a2f3-9c43e2e9413e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:05.896751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2809997-477a-4f26-a2f3-9c43e2e9413e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:05.924522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a9a17d8be24fb793bc0eb423a7f0dc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:05.962244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 894/1782] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:05 2022] DELETE /identity/v3/users/54a9a17d8be24fb793bc0eb423a7f0dc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:05.965970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:05.972992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:06.005905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 889/1783] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:05 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:06.008126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627beec5-451b-4620-984c-3112c7bff492 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.008416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627beec5-451b-4620-984c-3112c7bff492 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.011755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627beec5-451b-4620-984c-3112c7bff492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.070586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-627beec5-451b-4620-984c-3112c7bff492 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:06.072040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-627beec5-451b-4620-984c-3112c7bff492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:06.138940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a8366-1484-40bc-9078-0597d9a759cb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.251451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 890/1784] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:06.252506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627beec5-451b-4620-984c-3112c7bff492 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:06.255848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-627beec5-451b-4620-984c-3112c7bff492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:06.278609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.279755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.280332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.281134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.282055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.283309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627beec5-451b-4620-984c-3112c7bff492 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.284593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:06.297632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 895/1785] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:06.298921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.299195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:06.299791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.302469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:06.304667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.305154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.306740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.308661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:06.369939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 891/1786] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:06 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:06.369939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:06.392640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeddcd4-f851-44ae-b858-efef2ec5183d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.394497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f834d-35d4-48e0-8f61-0f21779b789d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.404846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.405758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.408060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.408445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.408859 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.409785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.412059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.415398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.415943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.420440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:06.447840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 892/1787] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:06.449333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:06.456852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.458337 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:06.475458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065390fb-9577-4b3b-8b6d-6c320eeaaeb7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.489700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.492947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.493345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.493726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.497728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.499603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:06.508876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:06.529857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 893/1788] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:06.533654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:06.554974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 896/1789] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:06.559987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:06.577527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f7ca7-5a32-4cf9-a0ef-dd2c90a01420 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.593023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963408d7-11a4-46fe-8a43-654b8041538a service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.601261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc29db9-d358-450b-9127-ac8bdb9ce133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.602114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29db9-d358-450b-9127-ac8bdb9ce133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.603143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29db9-d358-450b-9127-ac8bdb9ce133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.603433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29db9-d358-450b-9127-ac8bdb9ce133 admin admin] PATH_INFO: `/v3/projects/15790c0faec84e46861495320839f040/users/86674a0d6d6e4eac943c7d3d3eeab54d/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.612036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.614866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.615250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.619157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.620150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.621845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:06.671022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc29db9-d358-450b-9127-ac8bdb9ce133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15790c0faec84e46861495320839f040, user_id=86674a0d6d6e4eac943c7d3d3eeab54d, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.673181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 897/1790] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:06.674609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:06.678131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc29db9-d358-450b-9127-ac8bdb9ce133 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:06.734836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e69083-d2c1-4fee-9e34-a1d8cc44369d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:06.742427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 894/1791] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:06 2022] PUT /identity/v3/projects/15790c0faec84e46861495320839f040/users/86674a0d6d6e4eac943c7d3d3eeab54d/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:06.769217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1f49-ec42-4912-9dc9-36bd1e326c91 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.778414 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1f49-ec42-4912-9dc9-36bd1e326c91 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.778895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd1f49-ec42-4912-9dc9-36bd1e326c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.799330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:06.861670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e8bd1f49-ec42-4912-9dc9-36bd1e326c91 None None] MFA Rules not processed for user `86674a0d6d6e4eac943c7d3d3eeab54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:06.865081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e8bd1f49-ec42-4912-9dc9-36bd1e326c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:06.936449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5aede7-35b4-4f41-a356-aa98d6561f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:06.937465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aede7-35b4-4f41-a356-aa98d6561f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:06.937742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aede7-35b4-4f41-a356-aa98d6561f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:06.938014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5aede7-35b4-4f41-a356-aa98d6561f28 admin admin] PATH_INFO: `/v3/projects/36755043e7ce47bc99e7bf469c912551/users/512530c8f7724e4ea7a565279ddc0b8b/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:06.974566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aede7-35b4-4f41-a356-aa98d6561f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36755043e7ce47bc99e7bf469c912551, user_id=512530c8f7724e4ea7a565279ddc0b8b, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:06.977923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5aede7-35b4-4f41-a356-aa98d6561f28 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:07.010149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 898/1792] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:06 2022] PUT /identity/v3/projects/36755043e7ce47bc99e7bf469c912551/users/512530c8f7724e4ea7a565279ddc0b8b/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:07.023414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1cf0-d782-430c-9876-6ede45450471 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:07.023788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1cf0-d782-430c-9876-6ede45450471 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:07.024164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1cf0-d782-430c-9876-6ede45450471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:07.056769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 895/1793] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:07.069235 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1f49-ec42-4912-9dc9-36bd1e326c91 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:07.105880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd1f49-ec42-4912-9dc9-36bd1e326c91 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:07.121169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-18fa1cf0-d782-430c-9876-6ede45450471 None None] MFA Rules not processed for user `512530c8f7724e4ea7a565279ddc0b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:07.126178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-18fa1cf0-d782-430c-9876-6ede45450471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:07.303049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:07.304074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:07.307294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:07.308498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:07.312805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:07.325987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:07.433532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 899/1794] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:07.433945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 896/1795] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:07 2022] POST /identity/v3/projects => generated 363 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:07.436373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1cf0-d782-430c-9876-6ede45450471 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:07.439138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:07.477048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1cf0-d782-430c-9876-6ede45450471 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:07.689058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f671a5-6688-4388-9f25-6122ac2304c8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:07.694596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:07.695578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:07.695969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:07.696432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:07.697541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:07.699700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:07.701458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:07.708024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:07.710668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:07.711953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:07.712510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:07.714980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:07.728046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:07.773959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 900/1796] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:07 2022] POST /identity/v3/projects => generated 379 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:07.777591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:07.792777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 897/1797] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:07 2022] POST /identity/v3/users => generated 288 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:07.796893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:07.829661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521aacb-1177-47bf-b10d-d6b176a5bec0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:07.844640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:07.920149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff77c52-943a-4841-a5e9-9e81a7b383fe admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:07.942626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:07.943534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:07.943923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:07.944302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:07.945163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:07.947242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:07.995202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 901/1798] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:07 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:07.999606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:08.018429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce3ce7-1ec9-4115-b97c-9c1b56fa0f66 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:08.034873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.036975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.040551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.047561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.047923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.049741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.050783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.051714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.054519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.056079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.060639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.063747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.089207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 898/1799] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:08.091178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:08.095155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 902/1800] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:08.096956 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:08.119861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e07a6-79e3-4677-8933-8a9681dfc833 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:08.123134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd874b-5f16-4d6c-944f-70065bc1f16a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:08.133618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.136750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.137979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.138205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.138317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.138611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] PATH_INFO: `/v3/projects/0a022e3b0b52402099aa38ec1d806723/users/633771d9a1414713aefeba6372c5e95d/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.139424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.141395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] PATH_INFO: `/v3/projects/bcda6e90f7e2442fb2c8c241e4790c39/users/60fc92314fdd4370b2dea672e95dedcc/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.184861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a022e3b0b52402099aa38ec1d806723, user_id=633771d9a1414713aefeba6372c5e95d, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.191678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcda6e90f7e2442fb2c8c241e4790c39, user_id=60fc92314fdd4370b2dea672e95dedcc, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.195500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.199269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.241054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 899/1801] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:08 2022] PUT /identity/v3/projects/0a022e3b0b52402099aa38ec1d806723/users/633771d9a1414713aefeba6372c5e95d/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:08.246071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:08.248267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 903/1802] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:08 2022] PUT /identity/v3/projects/bcda6e90f7e2442fb2c8c241e4790c39/users/60fc92314fdd4370b2dea672e95dedcc/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:08.252977 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:08.481688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ea5c0-1f50-4af9-b43e-addfa3a65d74 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:08.501945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd654afd-68b2-477b-bca0-0949742e2ef7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:08.511111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.511835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.512222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.521557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.533731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.539786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.543455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.544769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.545073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.545360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.546194 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.552644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.576405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 900/1803] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:08.579202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:08.587631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 904/1804] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:08.588681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:08.601946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e4858-7f92-47a6-909b-2022cda8f3d7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:08.609369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7926e9-f276-4ad7-b5e5-c9575df40345 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:08.614389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79175f1-5477-4e49-89b3-d65acf6ce367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.615311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79175f1-5477-4e49-89b3-d65acf6ce367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.616643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79175f1-5477-4e49-89b3-d65acf6ce367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.616643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79175f1-5477-4e49-89b3-d65acf6ce367 admin admin] PATH_INFO: `/v3/projects/0a022e3b0b52402099aa38ec1d806723/users/633771d9a1414713aefeba6372c5e95d/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.619365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79175f1-5477-4e49-89b3-d65acf6ce367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a022e3b0b52402099aa38ec1d806723, user_id=633771d9a1414713aefeba6372c5e95d, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.624248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79175f1-5477-4e49-89b3-d65acf6ce367 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.625456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd4d8b-0282-4d81-8454-d0881b8313ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:08.626787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4d8b-0282-4d81-8454-d0881b8313ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.627375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4d8b-0282-4d81-8454-d0881b8313ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.627704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd4d8b-0282-4d81-8454-d0881b8313ab admin admin] PATH_INFO: `/v3/projects/bcda6e90f7e2442fb2c8c241e4790c39/users/60fc92314fdd4370b2dea672e95dedcc/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.632846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd4d8b-0282-4d81-8454-d0881b8313ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcda6e90f7e2442fb2c8c241e4790c39, user_id=60fc92314fdd4370b2dea672e95dedcc, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:08.641296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd4d8b-0282-4d81-8454-d0881b8313ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:08.658169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 901/1805] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:08 2022] PUT /identity/v3/projects/0a022e3b0b52402099aa38ec1d806723/users/633771d9a1414713aefeba6372c5e95d/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:08.669965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.670251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.670871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.675954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 905/1806] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:08 2022] PUT /identity/v3/projects/bcda6e90f7e2442fb2c8c241e4790c39/users/60fc92314fdd4370b2dea672e95dedcc/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:08.695581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:08.695903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:08.697451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:08.777888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] MFA Rules not processed for user `60fc92314fdd4370b2dea672e95dedcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:08.779758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:08.804132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] MFA Rules not processed for user `633771d9a1414713aefeba6372c5e95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:08.805414 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:08.843120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:09.013816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:09.043662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 906/1807] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:09.051028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:09.054374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:09.120367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 902/1808] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:09.121663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:09.124157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:09.297120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ca9a4-5e0c-4f56-ab33-656c6e69d56d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:09.334102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:09.335023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:09.335304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:09.338015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a43a-a977-403f-bccc-6b2ed775b420 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:09.339757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] PATH_INFO: `/v3/projects/6d1d28c3cb534080a1df499e0bff94c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:09.344242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d1d28c3cb534080a1df499e0bff94c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:09.349636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:09.352018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:09.352432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:09.353434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:09.353757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:09.395065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:09.398533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:09.445694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 903/1809] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:09.463460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:09.473413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:09.520067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97ba10-d700-4a87-bdc7-0284adee3000 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:09.576831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1d28c3cb534080a1df499e0bff94c1', 'request_id': 'req-973dffaa-054b-490a-809e-8aa149db1c16'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:09.603805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1d28c3cb534080a1df499e0bff94c1', 'request_id': 'req-973dffaa-054b-490a-809e-8aa149db1c16'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:09.630463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1d28c3cb534080a1df499e0bff94c1', 'request_id': 'req-973dffaa-054b-490a-809e-8aa149db1c16'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:09.662535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] The token cache is being invalidate because project 6d1d28c3cb534080a1df499e0bff94c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:09.662535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:09.664880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-973dffaa-054b-490a-809e-8aa149db1c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:09.681142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 907/1810] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:09 2022] DELETE /identity/v3/projects/6d1d28c3cb534080a1df499e0bff94c1 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:09.682879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:09.683172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:09.683453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:09.745360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4083-c9f8-4e38-81d0-9e9e4f653a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:09.746301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4083-c9f8-4e38-81d0-9e9e4f653a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:09.746586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4083-c9f8-4e38-81d0-9e9e4f653a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:09.746861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4083-c9f8-4e38-81d0-9e9e4f653a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:09.752276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] MFA Rules not processed for user `795571c4c2cc4f969ce487c0ec6dfbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:09.753810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e62b4083-c9f8-4e38-81d0-9e9e4f653a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:09.757633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:09.905140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:09.967901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 908/1811] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 23 11:32:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:09.968657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:09.979161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.002081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b4083-c9f8-4e38-81d0-9e9e4f653a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:10.003611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b4083-c9f8-4e38-81d0-9e9e4f653a08 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:10.022850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3233928-9386-4ca7-a276-cbd09b60f11d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:10.029802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 904/1812] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:10.031746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.032124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.032398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.052187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2bc82-4ab2-49ef-ac76-2a029b1ed02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:10.053426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2bc82-4ab2-49ef-ac76-2a029b1ed02a service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.053426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2bc82-4ab2-49ef-ac76-2a029b1ed02a service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.053617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2bc82-4ab2-49ef-ac76-2a029b1ed02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.063269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b1e2bc82-4ab2-49ef-ac76-2a029b1ed02a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.098455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:10.099720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.180755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:10.230495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 905/1813] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:10.231958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:10.237775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.276607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd9918-3b16-4d5f-ad7b-d38684ddfe1b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:10.288313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:10.289141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.289421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.289694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.308804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2bc82-4ab2-49ef-ac76-2a029b1ed02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:10.309317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:10.310868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:10.311344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2bc82-4ab2-49ef-ac76-2a029b1ed02a service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:10.334514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 906/1814] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:10.337277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:10.346702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 909/1815] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:10.351930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.354550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.356250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.361530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5ccc8-a7b4-4f4d-b4b8-926a62d86cbf service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:10.372967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:10.373616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.373899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.374179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.407982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:10.409659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:10.436306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:10.448952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.454353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 907/1816] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:10.456309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:10.460346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.508525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 910/1817] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:10.516103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:10.517059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dba5b-0c8d-4ac6-9b78-9d026c2c1223 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:10.521599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.538122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:10.539028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.539308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.539585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] PATH_INFO: `/v3/projects/3630731d86714bb0a2995446facd560e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.544338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3630731d86714bb0a2995446facd560e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:10.546236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:10.581923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f064a-d6dd-45b6-b0ef-9209e5e2e719 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:10.609984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:10.609984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.609984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.609984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.654853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:10.656000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:10.695362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 911/1818] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:10.696638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:10.705080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.739564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3630731d86714bb0a2995446facd560e', 'request_id': 'req-b542778d-bebf-4027-a306-4084d5d0a85c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:10.755270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33d534-587b-48e9-915a-6aa9f78979dc service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:10.775125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3630731d86714bb0a2995446facd560e', 'request_id': 'req-b542778d-bebf-4027-a306-4084d5d0a85c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:10.809593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3630731d86714bb0a2995446facd560e', 'request_id': 'req-b542778d-bebf-4027-a306-4084d5d0a85c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:10.848141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] The token cache is being invalidate because project 3630731d86714bb0a2995446facd560e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:10.848453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:10.849871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:10.865103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 908/1819] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:10 2022] DELETE /identity/v3/projects/3630731d86714bb0a2995446facd560e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:10.866338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:10.873191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:10.971254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:10.971530 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:10.971978 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:10.972265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:10.984056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:11.085386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542778d-bebf-4027-a306-4084d5d0a85c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:11.106286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:11.109201 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:11.109485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:11.109948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:11.122609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:11.124162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:11.124788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:11.184262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 909/1820] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:11.185331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:11.188581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:11.189930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:11.192757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:11.220907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 912/1821] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:11.225199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306da3c-26a6-4daa-8383-64734c9678df admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:11.226708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:11.241365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:11.242324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:11.250292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:11.250879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] PATH_INFO: `/v3/users/37913a53226c410eb8bc25ac87fbb811` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:11.257630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37913a53226c410eb8bc25ac87fbb811)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:11.260899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422f9c7-f1d3-4d4f-afc4-bf9599618898 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:11.262722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:11.276358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:11.277542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:11.277677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:11.278059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:11.278799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:11.282077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:11.352290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:11.356478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:11.385389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 913/1822] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:11 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:11.389205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:11.415325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37913a53226c410eb8bc25ac87fbb811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:11.445173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37913a53226c410eb8bc25ac87fbb811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:11.447364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37913a53226c410eb8bc25ac87fbb811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:11.448748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37913a53226c410eb8bc25ac87fbb811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:11.493666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37913a53226c410eb8bc25ac87fbb811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:11.548228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 910/1823] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:11 2022] DELETE /identity/v3/users/37913a53226c410eb8bc25ac87fbb811 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:11.744547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056e47-1f38-47bf-9c88-698b1174fe6b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:12.023579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:12.025462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:12.026357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:12.027388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:12.033881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:12.036361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:12.090601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 914/1824] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:11 2022] POST /identity/v3/users => generated 293 bytes in 702 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:12.092635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:12.094710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:12.188199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c038d-068a-4130-bee3-ed7d6fe8dc8f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:12.217693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:12.223110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:12.227701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:12.228196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:12.232288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:12.245491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:12.287058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 911/1825] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:12.288935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:12.307461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785fc42-43be-48ae-93d4-e3b23d92f6c5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:12.318499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da590c-44db-4f91-9e03-4036ff6d8bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:12.321395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da590c-44db-4f91-9e03-4036ff6d8bff admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:12.321875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da590c-44db-4f91-9e03-4036ff6d8bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:12.322303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da590c-44db-4f91-9e03-4036ff6d8bff admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:12.323860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da590c-44db-4f91-9e03-4036ff6d8bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:12.326812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da590c-44db-4f91-9e03-4036ff6d8bff admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:12.370671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 915/1826] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:12.372304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:12.395478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4559-751b-4358-8d0f-86dca384f3c0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:12.416365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:12.419782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:12.420309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:12.420908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] PATH_INFO: `/v3/projects/9baf54b39c0c43a4bbccf2360dc41a50/users/1c9ebbc07ad2466382f7a8880b1dfcf3/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:12.465892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9baf54b39c0c43a4bbccf2360dc41a50, user_id=1c9ebbc07ad2466382f7a8880b1dfcf3, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:12.474088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:12.518374 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 912/1827] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:12 2022] PUT /identity/v3/projects/9baf54b39c0c43a4bbccf2360dc41a50/users/1c9ebbc07ad2466382f7a8880b1dfcf3/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:12.528805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3e9a-7236-4854-9197-284f302bbfeb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:12.529230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3e9a-7236-4854-9197-284f302bbfeb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:12.529582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d3e9a-7236-4854-9197-284f302bbfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:12.645711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-820d3e9a-7236-4854-9197-284f302bbfeb None None] MFA Rules not processed for user `1c9ebbc07ad2466382f7a8880b1dfcf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:12.651270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-820d3e9a-7236-4854-9197-284f302bbfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:13.108431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 916/1828] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:13.109896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:13.330429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235fad7-2de6-4b24-a681-25c7c327ae2a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:13.336588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:13.337396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:13.337821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:13.338305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:13.339139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:13.341729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:13.395073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 913/1829] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:13 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:13.397246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d3e9a-7236-4854-9197-284f302bbfeb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:13.430146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d3e9a-7236-4854-9197-284f302bbfeb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:13.480343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:13.614648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:13.616633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:13.617138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:13.617606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:13.619614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:13.622975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:13.660877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 917/1830] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:13 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:13.664540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:13.683204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d602cb6-d123-4edc-bad5-672dad411920 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:13.698967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:13.699714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:13.699964 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:13.700249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:13.702007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:13.702669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:13.777005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 914/1831] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:13.781412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:13.803258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39394d-8c3e-46f7-8752-de67c4cd1db7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:13.839165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:13.840176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:13.840460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:13.840758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] PATH_INFO: `/v3/projects/9cc42394ee764b7ea4e4260150b348a3/users/833e8cfd319145cba2fbc88b005872aa/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:13.888302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc42394ee764b7ea4e4260150b348a3, user_id=833e8cfd319145cba2fbc88b005872aa, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:13.892907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:13.916928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 918/1832] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:13 2022] PUT /identity/v3/projects/9cc42394ee764b7ea4e4260150b348a3/users/833e8cfd319145cba2fbc88b005872aa/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:13.922743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:13.950299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6652250-37a1-4ea9-9c51-7995d8bc2863 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:14.067849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:14.122621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274f521-770a-4c51-814f-6205d15233ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:14.123413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274f521-770a-4c51-814f-6205d15233ad admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:14.123660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274f521-770a-4c51-814f-6205d15233ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:14.123957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274f521-770a-4c51-814f-6205d15233ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:14.124701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274f521-770a-4c51-814f-6205d15233ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:14.133519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274f521-770a-4c51-814f-6205d15233ad admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:14.172308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:14.187326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2a775-ea2b-4ba0-8137-6fd283396bce admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:14.191907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 915/1833] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:14.223479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:14.227280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:14.227557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:14.227926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] PATH_INFO: `/v3/projects/9cc42394ee764b7ea4e4260150b348a3/users/833e8cfd319145cba2fbc88b005872aa/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:14.237171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc42394ee764b7ea4e4260150b348a3, user_id=833e8cfd319145cba2fbc88b005872aa, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:14.256951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:14.350850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 919/1834] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:14 2022] PUT /identity/v3/projects/9cc42394ee764b7ea4e4260150b348a3/users/833e8cfd319145cba2fbc88b005872aa/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:14.366807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:14.367138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:14.367373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:14.468282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] MFA Rules not processed for user `833e8cfd319145cba2fbc88b005872aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:14.469616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:14.818626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 916/1835] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:14.825503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:14.828305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:14.986241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba0984-4192-4138-bf83-5273cc9fd7d0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:14.991576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:14.992610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:14.993206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:14.993835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:15.012167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:15.015572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:15.031007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 920/1836] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:15.170884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:15.173128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:15.200904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:15.202895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:15.445266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089fbb5-6b1c-41bb-99ff-e49c97dac3c6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:15.464973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606284bf-f9a8-44ea-bfab-e6eb15437dc1 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:15.467924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:15.470839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:15.471011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:15.471331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] PATH_INFO: `/v3/users/86674a0d6d6e4eac943c7d3d3eeab54d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:15.479697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86674a0d6d6e4eac943c7d3d3eeab54d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:15.481984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:15.491958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:15.493343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:15.493762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:15.494211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] PATH_INFO: `/v3/projects/b57b34306e3042c1b4e29112c874eb5a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:15.495863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b57b34306e3042c1b4e29112c874eb5a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:15.501386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:15.569038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:15.697111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86674a0d6d6e4eac943c7d3d3eeab54d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.777436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86674a0d6d6e4eac943c7d3d3eeab54d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.790659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86674a0d6d6e4eac943c7d3d3eeab54d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.793682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86674a0d6d6e4eac943c7d3d3eeab54d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.796067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57b34306e3042c1b4e29112c874eb5a', 'request_id': 'req-e244921b-a487-4a68-9033-ef226323d8be'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.847924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:15.870617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57b34306e3042c1b4e29112c874eb5a', 'request_id': 'req-e244921b-a487-4a68-9033-ef226323d8be'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.898882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-08b54d8e-d4e3-4369-a509-bbd71e8a9983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86674a0d6d6e4eac943c7d3d3eeab54d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.923752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57b34306e3042c1b4e29112c874eb5a', 'request_id': 'req-e244921b-a487-4a68-9033-ef226323d8be'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.945254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 917/1837] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:15 2022] DELETE /identity/v3/users/86674a0d6d6e4eac943c7d3d3eeab54d => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:15.952901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ba4e-4b03-4ece-bae3-f81b826fade7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:15.958666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] The token cache is being invalidate because project b57b34306e3042c1b4e29112c874eb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:15.959976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.966035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ba4e-4b03-4ece-bae3-f81b826fade7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:15.966535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e244921b-a487-4a68-9033-ef226323d8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:15.967467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2ba4e-4b03-4ece-bae3-f81b826fade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:15.977583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 921/1838] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:15 2022] DELETE /identity/v3/projects/b57b34306e3042c1b4e29112c874eb5a => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:15.983330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e407-5a5e-4a35-a827-9ddc0507abc1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:15.986150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e407-5a5e-4a35-a827-9ddc0507abc1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:15.986863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e407-5a5e-4a35-a827-9ddc0507abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.076055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1704e407-5a5e-4a35-a827-9ddc0507abc1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:16.085670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1704e407-5a5e-4a35-a827-9ddc0507abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.098968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bcc2ba4e-4b03-4ece-bae3-f81b826fade7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:16.101364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bcc2ba4e-4b03-4ece-bae3-f81b826fade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.365608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 922/1839] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:16.375213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609da33b-8218-4b02-9056-bbe75c0368cf None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.377156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609da33b-8218-4b02-9056-bbe75c0368cf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.377670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609da33b-8218-4b02-9056-bbe75c0368cf None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.392941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 923/1840] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:32:16 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:32:16.396525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497ebe-1bd4-4321-afa6-40f6fb05b5ba None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.398791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497ebe-1bd4-4321-afa6-40f6fb05b5ba None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.399982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497ebe-1bd4-4321-afa6-40f6fb05b5ba None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.402380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 918/1841] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:16.404889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009df94-b2d0-44c6-8343-391fb2737778 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.405489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 924/1842] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:32:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:32:16.409746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497ebe-1bd4-4321-afa6-40f6fb05b5ba None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:16.410359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009df94-b2d0-44c6-8343-391fb2737778 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.410764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009df94-b2d0-44c6-8343-391fb2737778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.418360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3a497ebe-1bd4-4321-afa6-40f6fb05b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.463265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8009df94-b2d0-44c6-8343-391fb2737778 None None] MFA Rules not processed for user `73c9e36a6c5f4bc8962ef86d39c496cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:16.464915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8009df94-b2d0-44c6-8343-391fb2737778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.475757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497ebe-1bd4-4321-afa6-40f6fb05b5ba None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:16.490314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:16.491506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.491892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.492314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] PATH_INFO: `/v3/users/1c9ebbc07ad2466382f7a8880b1dfcf3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.493734 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9ebbc07ad2466382f7a8880b1dfcf3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:16.495940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:16.609994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 919/1843] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:16.614121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9e5d-c0a9-4025-8402-150d8acde2bb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.614564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9e5d-c0a9-4025-8402-150d8acde2bb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.615116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9e5d-c0a9-4025-8402-150d8acde2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.635408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9ebbc07ad2466382f7a8880b1dfcf3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:16.643540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9ebbc07ad2466382f7a8880b1dfcf3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:16.645119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9ebbc07ad2466382f7a8880b1dfcf3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:16.645873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9ebbc07ad2466382f7a8880b1dfcf3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:16.656967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-76fa9e5d-c0a9-4025-8402-150d8acde2bb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:16.658654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-76fa9e5d-c0a9-4025-8402-150d8acde2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.665023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9ebbc07ad2466382f7a8880b1dfcf3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:16.683560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 920/1844] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:16.683560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13abe-98c6-49f6-9094-5169a477abba None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.685794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13abe-98c6-49f6-9094-5169a477abba None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.686825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a13abe-98c6-49f6-9094-5169a477abba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.692634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 925/1845] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:16 2022] DELETE /identity/v3/users/1c9ebbc07ad2466382f7a8880b1dfcf3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:16.693827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:16.698930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.749471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-56a13abe-98c6-49f6-9094-5169a477abba None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:16.759779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-56a13abe-98c6-49f6-9094-5169a477abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.770228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:16.893880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c26c6-5c4f-47d2-aed4-990adb480a12 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:16.904035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6975c-9a90-43bd-8426-967e410382c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:16.904749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6975c-9a90-43bd-8426-967e410382c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.905089 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6975c-9a90-43bd-8426-967e410382c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.905370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6975c-9a90-43bd-8426-967e410382c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:16.909889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-25c6975c-9a90-43bd-8426-967e410382c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:16.944355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 921/1846] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:32:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:16.952819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179117cd-a18f-4ad7-929b-e820570e8f0e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:16.953036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179117cd-a18f-4ad7-929b-e820570e8f0e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:16.953287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179117cd-a18f-4ad7-929b-e820570e8f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.022654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-179117cd-a18f-4ad7-929b-e820570e8f0e None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:17.023933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-179117cd-a18f-4ad7-929b-e820570e8f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:17.068289 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 922/1847] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:32:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:17.069039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179117cd-a18f-4ad7-929b-e820570e8f0e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:17.104306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:17.125575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6975c-9a90-43bd-8426-967e410382c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:17.127570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6975c-9a90-43bd-8426-967e410382c1 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:17.149162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 926/1848] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:17.150546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bcdcf-506c-4edb-aba1-ff584feffbd7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.150838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bcdcf-506c-4edb-aba1-ff584feffbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.151121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bcdcf-506c-4edb-aba1-ff584feffbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.172101 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-366bcdcf-506c-4edb-aba1-ff584feffbd7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:17.173545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-366bcdcf-506c-4edb-aba1-ff584feffbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:17.182609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 927/1849] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:17.275429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179117cd-a18f-4ad7-929b-e820570e8f0e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:17.288646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:17.292112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.292413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.293653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.316083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bcdcf-506c-4edb-aba1-ff584feffbd7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:17.319604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:17.320010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:17.322258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:17.348149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bcdcf-506c-4edb-aba1-ff584feffbd7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:17.367035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:17.368097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.368585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.369209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.389853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:17.392015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:17.392649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 923/1850] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:17.393665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:17.411139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 928/1851] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:17.429746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f566-0c2a-4cbb-b05d-2d7567f5b190 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:17.443173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:17.443930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.444215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.444492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.447849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:17.449857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:17.516140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 924/1852] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:17 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:17.527567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:17.550947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca4ea3-2eab-4842-9969-ec3dae3e3830 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:17.633626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:17.634338 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.634620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.634895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.635597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:17.637589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:17.689699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 929/1853] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:17 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:17.694060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:17.713787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db698d6e-0b49-4235-8a5f-fbe0428470c3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:17.740179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:17.741328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.741817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.742394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.744010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:17.746346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:17.785247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 925/1854] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:17.786508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:17.803022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd3da6-b9d4-4408-b2d7-19e85ef8a576 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:17.825116 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa96079-2618-42b6-b75a-fd8551ba55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:17.827600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96079-2618-42b6-b75a-fd8551ba55b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.827600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96079-2618-42b6-b75a-fd8551ba55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.827600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96079-2618-42b6-b75a-fd8551ba55b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:17.827600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa96079-2618-42b6-b75a-fd8551ba55b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:17.840837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa96079-2618-42b6-b75a-fd8551ba55b4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:17.907129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 930/1855] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:17.909425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:17.933946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8df64-b19f-465f-a7b1-ab3eb498a974 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:17.971638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:17.979284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:17.979572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:17.979856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] PATH_INFO: `/v3/projects/3e01a4d25ec14f89918bd93c30f4f007/users/b27efd2d5c0e4b09b795e290911db777/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:18.054554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e01a4d25ec14f89918bd93c30f4f007, user_id=b27efd2d5c0e4b09b795e290911db777, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:18.060103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:18.114434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 926/1856] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:17 2022] PUT /identity/v3/projects/3e01a4d25ec14f89918bd93c30f4f007/users/b27efd2d5c0e4b09b795e290911db777/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:18.115598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d198f-c829-49e6-89fe-48d1870b76e7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:18.115937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d198f-c829-49e6-89fe-48d1870b76e7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:18.116419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d198f-c829-49e6-89fe-48d1870b76e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:18.179704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f97d198f-c829-49e6-89fe-48d1870b76e7 None None] MFA Rules not processed for user `b27efd2d5c0e4b09b795e290911db777`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:18.181328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f97d198f-c829-49e6-89fe-48d1870b76e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:18.193206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:18.282667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:18.290750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 931/1857] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:18.446156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf8299-f743-4cf9-bfe3-ee3712cf6db4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:18.455062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:18.457157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:18.460210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:18.460210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:18.461647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:18.467298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:18.539191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d198f-c829-49e6-89fe-48d1870b76e7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:18.546261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 927/1858] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:18 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:18.554094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d198f-c829-49e6-89fe-48d1870b76e7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:18.659170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:18.661382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:18.736594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:18.749238 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:18.751161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:18.753837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:18.754247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:18.756098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:18.770479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:18.825128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a3aa1-a2fe-48d4-ad67-d3d995e60d0c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:18.840010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:18.841178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:18.841442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:18.841717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:18.849030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 932/1859] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:18 2022] POST /identity/v3/users => generated 295 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:18.854471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:18.858400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:18.860573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:18.894601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 928/1860] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:18.912872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7c6c3-c2e3-474e-bdff-58c79e26e9b9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:18.943805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:18.944499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:18.944801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:18.945703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:18.946456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:18.948091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:18.980576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 933/1861] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:18.986119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:19.013028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ea069-e590-44df-a6a3-3a2bef33f81e service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:19.027082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:19.028193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:19.032268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:19.032711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:19.033309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] PATH_INFO: `/v3/projects/1e9ab6b1d076477eaf0a8c2dd1f453de/users/5b24d7a254d34e7b9630409754bfe52b/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:19.070179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3386a-d94a-4d6b-ab2c-6fa8d7a4aa2a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:19.088608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9ab6b1d076477eaf0a8c2dd1f453de, user_id=5b24d7a254d34e7b9630409754bfe52b, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:19.092943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:19.093640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:19.093910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:19.094408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:19.099014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:19.118800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:19.120359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:19.145868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 929/1862] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:18 2022] PUT /identity/v3/projects/1e9ab6b1d076477eaf0a8c2dd1f453de/users/5b24d7a254d34e7b9630409754bfe52b/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:19.149305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:19.151917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 934/1863] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:19.275598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:19.278212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:19.310219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc3c3-7709-47d6-b3a6-8f3ef45eb5da service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:19.379380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aa7a7-70f9-4424-94fb-a8ce6010f473 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:19.403767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:19.404881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:19.405370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:19.405917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:19.413881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:19.437598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:19.475637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 930/1864] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:19.482820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:19.487714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:19.520299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157890b-45cd-44e0-bc4f-2896b28a61b4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:19.547599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:19.547599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:19.547599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:19.547599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] PATH_INFO: `/v3/projects/9baf54b39c0c43a4bbccf2360dc41a50` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:19.548028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9baf54b39c0c43a4bbccf2360dc41a50)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:19.548028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:19.569082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:19.575360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:19.578456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:19.578865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] PATH_INFO: `/v3/projects/15790c0faec84e46861495320839f040` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:19.584951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15790c0faec84e46861495320839f040)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:19.591425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:19.656858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9baf54b39c0c43a4bbccf2360dc41a50', 'request_id': 'req-e40f49fe-63dd-4473-914d-ba1edabb0db8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.672249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9baf54b39c0c43a4bbccf2360dc41a50', 'request_id': 'req-e40f49fe-63dd-4473-914d-ba1edabb0db8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.687597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:19.692630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9baf54b39c0c43a4bbccf2360dc41a50', 'request_id': 'req-e40f49fe-63dd-4473-914d-ba1edabb0db8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.733846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] The token cache is being invalidate because project 9baf54b39c0c43a4bbccf2360dc41a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:19.734789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.735564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.738470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 931/1865] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:19 2022] DELETE /identity/v3/projects/9baf54b39c0c43a4bbccf2360dc41a50 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:19.739236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:19.741686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:19.759291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:19.765842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15790c0faec84e46861495320839f040', 'request_id': 'req-b5530e42-f0ad-4ae3-a21e-1f3083683832'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.785834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15790c0faec84e46861495320839f040', 'request_id': 'req-b5530e42-f0ad-4ae3-a21e-1f3083683832'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.807552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15790c0faec84e46861495320839f040', 'request_id': 'req-b5530e42-f0ad-4ae3-a21e-1f3083683832'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.847129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] The token cache is being invalidate because project 15790c0faec84e46861495320839f040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:19.847873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.848747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:19.853869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 935/1866] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:19 2022] DELETE /identity/v3/projects/15790c0faec84e46861495320839f040 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:19.854769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:19.856247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:19.924048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f49fe-63dd-4473-914d-ba1edabb0db8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:20.036631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5530e42-f0ad-4ae3-a21e-1f3083683832 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:20.058584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:20.059532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.059815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.060094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] PATH_INFO: `/v3/projects/1e9ab6b1d076477eaf0a8c2dd1f453de/users/5b24d7a254d34e7b9630409754bfe52b/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.066154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9ab6b1d076477eaf0a8c2dd1f453de, user_id=5b24d7a254d34e7b9630409754bfe52b, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:20.073073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:20.074435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:20.075239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.075520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.075968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] PATH_INFO: `/v3/users/512530c8f7724e4ea7a565279ddc0b8b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.077582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=512530c8f7724e4ea7a565279ddc0b8b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:20.082107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:20.114790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 936/1867] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:19 2022] PUT /identity/v3/projects/1e9ab6b1d076477eaf0a8c2dd1f453de/users/5b24d7a254d34e7b9630409754bfe52b/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:20.115844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:20.117737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:20.245574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512530c8f7724e4ea7a565279ddc0b8b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.258200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512530c8f7724e4ea7a565279ddc0b8b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.260324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512530c8f7724e4ea7a565279ddc0b8b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.269568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512530c8f7724e4ea7a565279ddc0b8b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.308120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512530c8f7724e4ea7a565279ddc0b8b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.329701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3985d-70fc-42d4-bb53-0dd3374579bb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:20.330939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 932/1868] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:19 2022] DELETE /identity/v3/users/512530c8f7724e4ea7a565279ddc0b8b => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:20.332133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:20.336067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:20.401619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:20.454998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eca4f-26d5-4057-9c1f-362731df3a1f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:20.456202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:20.470809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:20.472126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.472550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.472864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] PATH_INFO: `/v3/users/633771d9a1414713aefeba6372c5e95d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.474931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=633771d9a1414713aefeba6372c5e95d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:20.477524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:20.486153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:20.487276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.487501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.488084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] PATH_INFO: `/v3/users/833e8cfd319145cba2fbc88b005872aa` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.490650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=833e8cfd319145cba2fbc88b005872aa)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:20.498875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:20.594225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833e8cfd319145cba2fbc88b005872aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.600630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633771d9a1414713aefeba6372c5e95d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.604504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833e8cfd319145cba2fbc88b005872aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.605464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833e8cfd319145cba2fbc88b005872aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.606275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833e8cfd319145cba2fbc88b005872aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.611595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633771d9a1414713aefeba6372c5e95d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.612527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633771d9a1414713aefeba6372c5e95d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.613210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633771d9a1414713aefeba6372c5e95d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.635568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-19ec87ac-914a-46cd-88f1-68f74ef54088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633771d9a1414713aefeba6372c5e95d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.653804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea60e26a-b4e6-494d-8dd6-01fb6958e43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833e8cfd319145cba2fbc88b005872aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:20.655122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 933/1869] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:20 2022] DELETE /identity/v3/users/633771d9a1414713aefeba6372c5e95d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:20.656665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.657035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.657373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.685208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 937/1870] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:20 2022] DELETE /identity/v3/users/833e8cfd319145cba2fbc88b005872aa => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:20.686899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.687190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.687466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.693195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] MFA Rules not processed for user `5b24d7a254d34e7b9630409754bfe52b`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:20.694521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:20.714080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:20.715361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:20.813560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 938/1871] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:20.829607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 934/1872] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:20.834524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:20.835984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:20.840685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:20.844804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:20.918001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132209b9-2b59-452c-9e2d-97682654c6b2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:20.922367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:20.923054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.923336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.923687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.934537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:20.935994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:20.947510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 939/1873] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:20.948840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:20.968433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d313-2f75-4190-8f89-0a1fed46e359 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:20.974125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:20.975435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:20.975435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:20.975680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:20.979278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:21.075023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:21.076746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:21.087456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 935/1874] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:21.578563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:21.580329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:21.618761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9cef-ccf0-486d-b6b7-6080e08995db service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:21.635539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:21.636461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:21.636767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:21.637049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] PATH_INFO: `/v3/projects/0a022e3b0b52402099aa38ec1d806723` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:21.638778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a022e3b0b52402099aa38ec1d806723)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:21.640789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:21.652666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:21.654219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:21.670207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:21.690869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf260b9-5166-4e7a-ab3b-8577d991dfc5 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:21.709022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:21.709895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:21.710180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:21.710506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] PATH_INFO: `/v3/projects/36755043e7ce47bc99e7bf469c912551` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:21.711739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36755043e7ce47bc99e7bf469c912551)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:21.713712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:21.812524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a022e3b0b52402099aa38ec1d806723', 'request_id': 'req-566e8c0f-32c6-45d5-b947-31324b64c894'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.829367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a022e3b0b52402099aa38ec1d806723', 'request_id': 'req-566e8c0f-32c6-45d5-b947-31324b64c894'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.839854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36755043e7ce47bc99e7bf469c912551', 'request_id': 'req-a69687be-f3f0-4572-9920-779ef9b99f88'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.846643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a022e3b0b52402099aa38ec1d806723', 'request_id': 'req-566e8c0f-32c6-45d5-b947-31324b64c894'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.847404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36755043e7ce47bc99e7bf469c912551', 'request_id': 'req-a69687be-f3f0-4572-9920-779ef9b99f88'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.854472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36755043e7ce47bc99e7bf469c912551', 'request_id': 'req-a69687be-f3f0-4572-9920-779ef9b99f88'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.869183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] The token cache is being invalidate because project 0a022e3b0b52402099aa38ec1d806723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:21.869493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.870615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.877036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 940/1875] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:21 2022] DELETE /identity/v3/projects/0a022e3b0b52402099aa38ec1d806723 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:21.877036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:21.877036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:21.877710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] The token cache is being invalidate because project 36755043e7ce47bc99e7bf469c912551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:21.878186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.879002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a69687be-f3f0-4572-9920-779ef9b99f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:21.895847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 936/1876] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:21 2022] DELETE /identity/v3/projects/36755043e7ce47bc99e7bf469c912551 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:21.895847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:21.895847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:21.896496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:21.927135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:21.928424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:21.960642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8c0f-32c6-45d5-b947-31324b64c894 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.012967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 937/1877] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:22.020103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.021604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.026229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.027132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.027432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.027742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] PATH_INFO: `/v3/projects/9cc42394ee764b7ea4e4260150b348a3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.029044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc42394ee764b7ea4e4260150b348a3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.030972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.034625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d304f2-8442-4fa3-8f06-2fa777d22723 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.039237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.040141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.040424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.040863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] PATH_INFO: `/v3/users/60fc92314fdd4370b2dea672e95dedcc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.042073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fc92314fdd4370b2dea672e95dedcc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.044025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.061338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:22.103970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:22.109421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc42394ee764b7ea4e4260150b348a3', 'request_id': 'req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.122284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc42394ee764b7ea4e4260150b348a3', 'request_id': 'req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.126266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fc92314fdd4370b2dea672e95dedcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.137688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fc92314fdd4370b2dea672e95dedcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.139467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fc92314fdd4370b2dea672e95dedcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.141752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc42394ee764b7ea4e4260150b348a3', 'request_id': 'req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.149802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fc92314fdd4370b2dea672e95dedcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.161783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] The token cache is being invalidate because project 9cc42394ee764b7ea4e4260150b348a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:22.162169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.162907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2b986df6-ba4f-4d9e-bd5c-7df80d0e8ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.164750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 941/1878] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:21 2022] DELETE /identity/v3/projects/9cc42394ee764b7ea4e4260150b348a3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:22.165965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3744d69-0ea0-44b0-af48-45ac7eb3f85d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.166304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3744d69-0ea0-44b0-af48-45ac7eb3f85d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.166661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3744d69-0ea0-44b0-af48-45ac7eb3f85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.179025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cb20dd87-424d-42c9-881c-c52e65c6933d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fc92314fdd4370b2dea672e95dedcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.186976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b3744d69-0ea0-44b0-af48-45ac7eb3f85d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:22.188202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b3744d69-0ea0-44b0-af48-45ac7eb3f85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.194558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 938/1879] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:22 2022] DELETE /identity/v3/users/60fc92314fdd4370b2dea672e95dedcc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:22.195861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf82d-2729-45c3-95ec-7042ff9ac02f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.196223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf82d-2729-45c3-95ec-7042ff9ac02f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.196573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf82d-2729-45c3-95ec-7042ff9ac02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.231138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e3fcf82d-2729-45c3-95ec-7042ff9ac02f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:22.232996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e3fcf82d-2729-45c3-95ec-7042ff9ac02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.271757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 942/1880] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:22.275965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3744d69-0ea0-44b0-af48-45ac7eb3f85d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.292214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3744d69-0ea0-44b0-af48-45ac7eb3f85d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.309750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 939/1881] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:22.317464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86fc5-1897-48b3-a20f-c40589596c52 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.317760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86fc5-1897-48b3-a20f-c40589596c52 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.318210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e86fc5-1897-48b3-a20f-c40589596c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.338707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-42e86fc5-1897-48b3-a20f-c40589596c52 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:22.339659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-42e86fc5-1897-48b3-a20f-c40589596c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.353543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 940/1882] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:22.355152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e86fc5-1897-48b3-a20f-c40589596c52 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.355339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.356077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.356361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.356662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.357442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:22.357758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.359379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.366296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e86fc5-1897-48b3-a20f-c40589596c52 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.371772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.372521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.376329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.376601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 943/1883] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:22.376701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.376701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:22.376701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.376701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.388676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.394214 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 941/1884] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:22.398542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.404353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85ad40-88d4-4cb6-947e-75c0efcbb706 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.409914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415f345-77ad-47a8-b6f6-63ae0c92fb94 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.411438 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.412199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.412544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.412945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.413720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.415372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.415841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.416166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.416655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.417020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.417770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.419957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.454505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 942/1885] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:22.454722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 944/1886] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:22.456001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.456182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.506770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:22.519019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:22.530629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a289c-bb9f-4366-adf0-09425cabd69a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.536417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.537085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.537369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.537803 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.538510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.540043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599d06-7bfb-46f6-8690-6d14ea42199a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.541658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.547340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.548239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.548668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.548992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.549748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.552344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.572450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 945/1887] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:22.573357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.575751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.578944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 943/1888] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:22.578944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.589133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6be2cc-a130-4602-90f4-846c983d50ad admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.590244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e2c3-a3ee-49de-9f10-bf88bca88b0b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.594535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.595281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.595436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.595708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.596263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.596375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.596627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.597017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] PATH_INFO: `/v3/projects/bcda6e90f7e2442fb2c8c241e4790c39` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.597634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.598217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcda6e90f7e2442fb2c8c241e4790c39)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.599491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.600166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.610161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 944/1889] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:22.610903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.621827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed9ad2-8607-405d-a826-df3ca0ffbad8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.629478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.630412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.630750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.631102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.632218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.633902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.646231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 945/1890] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:22.647438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.659521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd81fa-819b-4337-a8fd-342b73230a96 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.678022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcda6e90f7e2442fb2c8c241e4790c39', 'request_id': 'req-d3e22c5a-4403-4978-bf1d-a071cffedcb6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.689823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcda6e90f7e2442fb2c8c241e4790c39', 'request_id': 'req-d3e22c5a-4403-4978-bf1d-a071cffedcb6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.704882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcda6e90f7e2442fb2c8c241e4790c39', 'request_id': 'req-d3e22c5a-4403-4978-bf1d-a071cffedcb6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.732694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] The token cache is being invalidate because project bcda6e90f7e2442fb2c8c241e4790c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:22.733026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.733717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:22.736806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 946/1891] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:22 2022] DELETE /identity/v3/projects/bcda6e90f7e2442fb2c8c241e4790c39 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:22.737727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.739711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e4257-005e-40cb-bb54-c104dddf08d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.740280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e4257-005e-40cb-bb54-c104dddf08d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.740567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e4257-005e-40cb-bb54-c104dddf08d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.740879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e4257-005e-40cb-bb54-c104dddf08d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.741613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e4257-005e-40cb-bb54-c104dddf08d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.743223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e4257-005e-40cb-bb54-c104dddf08d9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.748685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.757056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 946/1892] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:22.757056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ce0c7-2e6d-4710-b3ff-bb2944b5ff9f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.757056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ce0c7-2e6d-4710-b3ff-bb2944b5ff9f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.757056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ce0c7-2e6d-4710-b3ff-bb2944b5ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.763015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e22c5a-4403-4978-bf1d-a071cffedcb6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.769013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.769789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.770137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.770514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.771316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.773108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.777646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1a1ce0c7-2e6d-4710-b3ff-bb2944b5ff9f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:22.779307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a1ce0c7-2e6d-4710-b3ff-bb2944b5ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.784895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 947/1893] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:22.788181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.790117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 947/1894] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:22.790763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ce0c7-2e6d-4710-b3ff-bb2944b5ff9f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:22.796753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.800671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ce0c7-2e6d-4710-b3ff-bb2944b5ff9f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.806373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d0f31-2bee-4118-bc3b-c5a9474e85e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.807352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d0f31-2bee-4118-bc3b-c5a9474e85e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.807831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d0f31-2bee-4118-bc3b-c5a9474e85e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.808181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d0f31-2bee-4118-bc3b-c5a9474e85e0 admin admin] PATH_INFO: `/v3/projects/357f3226d7904725915751642be9ad5f/users/675a51bfebc644e898886a9540a27a17/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.813016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250fd2e-8b54-4d2f-bc30-4be32ce7d8c4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:22.820465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360add6-4050-4bbb-9cab-2b17dd6b52da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:22.821488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360add6-4050-4bbb-9cab-2b17dd6b52da admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.821755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360add6-4050-4bbb-9cab-2b17dd6b52da admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.822059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360add6-4050-4bbb-9cab-2b17dd6b52da admin admin] PATH_INFO: `/v3/projects/865986d03066474aa587b8f9967f279c/users/5c6cdc3fd22c4493ab944941020af55e/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.842354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360add6-4050-4bbb-9cab-2b17dd6b52da admin admin] RBAC: Authorizing `identity:create_grant(project_id=865986d03066474aa587b8f9967f279c, user_id=5c6cdc3fd22c4493ab944941020af55e, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.842504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d0f31-2bee-4118-bc3b-c5a9474e85e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357f3226d7904725915751642be9ad5f, user_id=675a51bfebc644e898886a9540a27a17, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:22.845084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d0f31-2bee-4118-bc3b-c5a9474e85e0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.845672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360add6-4050-4bbb-9cab-2b17dd6b52da admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:22.876850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 948/1896] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:22 2022] PUT /identity/v3/projects/865986d03066474aa587b8f9967f279c/users/5c6cdc3fd22c4493ab944941020af55e/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:22.876850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36da2-3a62-4d36-8f32-882b5b0627bb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.876850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36da2-3a62-4d36-8f32-882b5b0627bb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.876850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36da2-3a62-4d36-8f32-882b5b0627bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.877356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 948/1896] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:22 2022] PUT /identity/v3/projects/357f3226d7904725915751642be9ad5f/users/675a51bfebc644e898886a9540a27a17/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:22.881262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcbdf8-b39b-481f-8c4a-b649e34509c7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:22.881632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcbdf8-b39b-481f-8c4a-b649e34509c7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:22.885303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcbdf8-b39b-481f-8c4a-b649e34509c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:22.908800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e9d36da2-3a62-4d36-8f32-882b5b0627bb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:22.910276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e9d36da2-3a62-4d36-8f32-882b5b0627bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:22.930733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-64fcbdf8-b39b-481f-8c4a-b649e34509c7 None None] MFA Rules not processed for user `675a51bfebc644e898886a9540a27a17`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:22.932012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64fcbdf8-b39b-481f-8c4a-b649e34509c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:23.016081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 949/1897] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:23.017947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bca7-58a8-46d2-b6a4-7ac58b3f0bc1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.018237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bca7-58a8-46d2-b6a4-7ac58b3f0bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.018516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7bca7-58a8-46d2-b6a4-7ac58b3f0bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.021803 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 949/1898] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:23.023617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36da2-3a62-4d36-8f32-882b5b0627bb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.036797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36da2-3a62-4d36-8f32-882b5b0627bb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.038542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:23.046589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.047051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.047320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.047603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.047975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-84d7bca7-58a8-46d2-b6a4-7ac58b3f0bc1 None None] MFA Rules not processed for user `5c6cdc3fd22c4493ab944941020af55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:23.048301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.050441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-84d7bca7-58a8-46d2-b6a4-7ac58b3f0bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:23.052017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.082523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:23.091495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 950/1899] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:23.096213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.132389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 950/1900] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:23.135723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7bca7-58a8-46d2-b6a4-7ac58b3f0bc1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.147981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7bca7-58a8-46d2-b6a4-7ac58b3f0bc1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.186549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8ba9a-1b36-4576-b90f-092877c519a2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.191619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.192363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.192708 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.193072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.193884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:23.194248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.196046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.207221 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.207843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.208123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.208396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.208506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 951/1901] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:23.209131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.209314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.211036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.218572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9db548-5dcf-44ff-abf9-df5f84314ff9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.224770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.225540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.225864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.226162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.227140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.229067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.232413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 951/1902] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:23.233315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.243094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41811ffb-5de7-480e-9b99-b232562e7279 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.248309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.248978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.249243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.249517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.250231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.252384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.259422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 952/1903] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:23.260170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.281896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 952/1904] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:23.282699 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.326798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79ff77-eaf7-4369-83b9-12294208778d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.349627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bda7f1-0157-4193-9298-7048040a7d77 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.354890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.355667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.356019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.356385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.357228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.359190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.376040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:23.385645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 953/1905] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:23.385645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.393630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.394391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.394675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.394966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.395706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.396635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3e53b-6efd-4469-bd65-f36e6384650e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.397613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.401723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.402515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.402889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.403256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.404036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.406053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.412481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 953/1906] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:23.412481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.423026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6aa44-f3c0-4e10-bf21-f5a73315ef59 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.429145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.429833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.430118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.430418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.434015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 954/1907] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/users => generated 294 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:23.434173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.434280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.434365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.443351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 954/1908] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:23.444035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.446783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4b4a8-933a-4237-8018-3d2bd2f12634 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.450413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:23.452104 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.453214 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.453568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.453913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] PATH_INFO: `/v3/projects/865684d3e7fb4463b323d821f425ac31/users/dc576d7e1abd4b32ace11333fdfef8dd/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.454852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f8673-db00-4978-968e-f479fcba6672 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.461186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.461911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.462371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.462734 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.463568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.465557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.474576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865684d3e7fb4463b323d821f425ac31, user_id=dc576d7e1abd4b32ace11333fdfef8dd, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.477398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 955/1909] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:23.477533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.478431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.489783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409a068-539c-44c9-81a4-159c314aa740 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.494487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.495379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.495662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.495941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] PATH_INFO: `/v3/projects/75ea2e8c953345d09457eaa175b2aa49/users/8cefc7dc863f43e99b9da12bc76440f1/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.508056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 955/1910] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:23 2022] PUT /identity/v3/projects/865684d3e7fb4463b323d821f425ac31/users/dc576d7e1abd4b32ace11333fdfef8dd/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:23.509259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.516027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ea2e8c953345d09457eaa175b2aa49, user_id=8cefc7dc863f43e99b9da12bc76440f1, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.519424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.535718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 956/1911] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:23 2022] PUT /identity/v3/projects/75ea2e8c953345d09457eaa175b2aa49/users/8cefc7dc863f43e99b9da12bc76440f1/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:23.540195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.595716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41ff92-4bac-4d43-8258-d50bb6bc0c21 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.620418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357895a-ae49-4c8e-81fe-05ea0dacc968 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.628381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.629466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.630416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.630887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.632320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.635555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.663704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 957/1912] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:23.666594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.681060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70439703-16a4-4551-b7a1-4b843a63b102 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.689828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.690889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.691403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.691873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.692928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.696841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.703444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.704140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.704495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.704795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.705828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.707562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.720914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 958/1913] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:23.721932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.733536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e439f01-5a7f-4653-bb1c-b88cf6983804 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.737449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 956/1914] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:23.738524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.744965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9814fe-a2ce-4f2e-958d-d8f329be2f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.745905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9814fe-a2ce-4f2e-958d-d8f329be2f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.746189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9814fe-a2ce-4f2e-958d-d8f329be2f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.746597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9814fe-a2ce-4f2e-958d-d8f329be2f7a admin admin] PATH_INFO: `/v3/projects/865684d3e7fb4463b323d821f425ac31/users/dc576d7e1abd4b32ace11333fdfef8dd/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.754469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d961195-5880-48d7-b916-46ea323aa568 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.757534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9814fe-a2ce-4f2e-958d-d8f329be2f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=865684d3e7fb4463b323d821f425ac31, user_id=dc576d7e1abd4b32ace11333fdfef8dd, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.760205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.760694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9814fe-a2ce-4f2e-958d-d8f329be2f7a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.761453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.761800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.762169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] PATH_INFO: `/v3/projects/75ea2e8c953345d09457eaa175b2aa49/users/8cefc7dc863f43e99b9da12bc76440f1/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.765785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ea2e8c953345d09457eaa175b2aa49, user_id=8cefc7dc863f43e99b9da12bc76440f1, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.770867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.787294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 957/1915] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:23 2022] PUT /identity/v3/projects/75ea2e8c953345d09457eaa175b2aa49/users/8cefc7dc863f43e99b9da12bc76440f1/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:23.788413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:23.808063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 959/1916] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:23 2022] PUT /identity/v3/projects/865684d3e7fb4463b323d821f425ac31/users/dc576d7e1abd4b32ace11333fdfef8dd/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:23.808063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf752c6-6ec8-4ced-86c1-10845111b18c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.808063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf752c6-6ec8-4ced-86c1-10845111b18c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.808063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf752c6-6ec8-4ced-86c1-10845111b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.854669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:23.871930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8cf752c6-6ec8-4ced-86c1-10845111b18c None None] MFA Rules not processed for user `8cefc7dc863f43e99b9da12bc76440f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:23.873440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8cf752c6-6ec8-4ced-86c1-10845111b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:23.887409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd7c4b-c418-43da-9178-ccb31a73db1f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:23.893965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c1b65-5f04-4ceb-9955-3c941bde60d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:23.894898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1b65-5f04-4ceb-9955-3c941bde60d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.895179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1b65-5f04-4ceb-9955-3c941bde60d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.895493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1b65-5f04-4ceb-9955-3c941bde60d1 admin admin] PATH_INFO: `/v3/projects/2325a52a64aa44aead308e9cf5f1dec4/users/f464f2e2879d4eabb53463e7b37afe20/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:23.922605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c1b65-5f04-4ceb-9955-3c941bde60d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2325a52a64aa44aead308e9cf5f1dec4, user_id=f464f2e2879d4eabb53463e7b37afe20, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:23.927455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c1b65-5f04-4ceb-9955-3c941bde60d1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:23.959969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 958/1917] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:23 2022] PUT /identity/v3/projects/2325a52a64aa44aead308e9cf5f1dec4/users/f464f2e2879d4eabb53463e7b37afe20/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:23.959969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:23.959969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:23.959969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.010246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 960/1918] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:24.012569 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.014022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.014315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.026060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] MFA Rules not processed for user `dc576d7e1abd4b32ace11333fdfef8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:24.027308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:24.081575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] MFA Rules not processed for user `f464f2e2879d4eabb53463e7b37afe20`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:24.082867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:24.099420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:24.171373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 961/1919] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:24.177490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.179336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:24.210975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 959/1920] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:24.213160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.217934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:24.295071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5890c4-b71b-486a-99cd-00955323a251 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.305756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.306358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.306809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.306925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.339690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577235a4-895e-41fe-8ab3-2ea4be2b764e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.343609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.344276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.344615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.344965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.347178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:24.404233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.407382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.420069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 962/1921] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:24.421346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.447769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.450049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.495891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6455d-de48-40c2-9753-cf18b476b5d6 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.501306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.502102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.503112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.503644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.504444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.506725 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.517748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 960/1922] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:24.525166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:24.526705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.541851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:24.553179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 963/1923] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:24 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:24.557468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.558216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd876e8-92c7-4ee8-ba17-897c16448200 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.646799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463dd7a9-3037-4377-8b4f-f72bf7e12231 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.655711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.656739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.657053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.657386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.658436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.661392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.703432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 964/1924] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:24 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:24.705652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d0fdd-4ae3-4b08-9c0a-a22f532feca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.709843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d0fdd-4ae3-4b08-9c0a-a22f532feca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.710982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d0fdd-4ae3-4b08-9c0a-a22f532feca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.711525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d0fdd-4ae3-4b08-9c0a-a22f532feca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.717885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.742730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad212088-cb6f-4663-a38e-3cc97e859094 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.752146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.752963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.753256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.753539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.754292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.755918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.788651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 965/1925] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:24.792368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.816599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f23b24-3913-4ced-a3ce-d043802f7df4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.822650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.823334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.823619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.823901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.824636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.826296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.838436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d0fdd-4ae3-4b08-9c0a-a22f532feca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.839363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 966/1926] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:24.840942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d0fdd-4ae3-4b08-9c0a-a22f532feca3 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.845743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:24.860550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2af4-96d7-4b1f-b3be-b73585434b0f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:24.866254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 961/1927] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:24.868498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:24.870377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.870377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.871307 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] PATH_INFO: `/v3/projects/f0ee0c0c799645f3bab15bf61b25584c/users/e081c3aeca9949ac94ed1cf581f832e0/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.892122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ee0c0c799645f3bab15bf61b25584c, user_id=e081c3aeca9949ac94ed1cf581f832e0, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:24.897083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:24.926870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 967/1928] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:24 2022] PUT /identity/v3/projects/f0ee0c0c799645f3bab15bf61b25584c/users/e081c3aeca9949ac94ed1cf581f832e0/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:24.928193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac8f8-a7cc-4a59-b4ee-c734bddf40df None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:24.928487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac8f8-a7cc-4a59-b4ee-c734bddf40df None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:24.928899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ac8f8-a7cc-4a59-b4ee-c734bddf40df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:24.982906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-319ac8f8-a7cc-4a59-b4ee-c734bddf40df None None] MFA Rules not processed for user `e081c3aeca9949ac94ed1cf581f832e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:24.984267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-319ac8f8-a7cc-4a59-b4ee-c734bddf40df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:25.013266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:25.153731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00957ddb-2982-4bbe-823b-4144864b40e0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:25.173182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:25.174185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.175020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.175020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] PATH_INFO: `/v3/users/675a51bfebc644e898886a9540a27a17` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:25.179495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675a51bfebc644e898886a9540a27a17)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:25.181541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:25.208326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 962/1929] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:25.213807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ac8f8-a7cc-4a59-b4ee-c734bddf40df None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:25.244873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ac8f8-a7cc-4a59-b4ee-c734bddf40df None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:25.260383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:25.261116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.261409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.261751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:25.262383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:25.264330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:25.311826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:25.320236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 963/1930] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:25 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:25.324152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:25.327277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675a51bfebc644e898886a9540a27a17'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.341583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675a51bfebc644e898886a9540a27a17'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.342924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675a51bfebc644e898886a9540a27a17'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.343656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675a51bfebc644e898886a9540a27a17'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.372956 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eec064d0-b889-4979-8800-d15a62612aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675a51bfebc644e898886a9540a27a17'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.391592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:25.480703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 968/1931] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:25 2022] DELETE /identity/v3/users/675a51bfebc644e898886a9540a27a17 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:25.482668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.482959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.483239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:25.523276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801055bc-d55f-4749-8d91-885bd616242d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:25.545591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:25.546830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:25.640608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:25.641352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.641609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.641884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:25.642584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:25.646137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:25.685662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 964/1932] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:25 2022] POST /identity/v3/users => generated 300 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:25.685958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:25.687738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 969/1933] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:25.688555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:25.690717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:25.693742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:25.706773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ebac1-90cc-4e9d-8142-7f7f1897bd92 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:25.711960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42817d5e-b54a-4da6-825e-805ed2d57f17 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:25.719484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:25.720189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.720473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.720792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:25.721591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:25.723753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:25.726479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:25.727487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.727618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.727904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] PATH_INFO: `/v3/users/5c6cdc3fd22c4493ab944941020af55e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:25.730083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6cdc3fd22c4493ab944941020af55e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:25.732133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:25.755988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 970/1934] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:25.758229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:25.762536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:25.841384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6cdc3fd22c4493ab944941020af55e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.853600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6cdc3fd22c4493ab944941020af55e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.854470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6cdc3fd22c4493ab944941020af55e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.855668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6cdc3fd22c4493ab944941020af55e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.885543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6cdc3fd22c4493ab944941020af55e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:25.900285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b96f8-a8ca-4ba5-9748-53e840ae932e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:25.915584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74213-0f31-42ce-bcbf-f2c061fafb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:25.916279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74213-0f31-42ce-bcbf-f2c061fafb61 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.917000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 965/1935] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:25 2022] DELETE /identity/v3/users/5c6cdc3fd22c4493ab944941020af55e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:25.917791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74213-0f31-42ce-bcbf-f2c061fafb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.918076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74213-0f31-42ce-bcbf-f2c061fafb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:25.918861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:25.922241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:25.923302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7da74213-0f31-42ce-bcbf-f2c061fafb61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:25.956588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74213-0f31-42ce-bcbf-f2c061fafb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:25.962823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74213-0f31-42ce-bcbf-f2c061fafb61 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:25.992564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 971/1936] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:25.994112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:25.994404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:25.994675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.007474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:26.038422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:26.039733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:26.092485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e55fda-d38e-489c-ade0-ff2940ff44be admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:26.096846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:26.097748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:26.098668 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.099091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.099370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] PATH_INFO: `/v3/projects/e7d238d779444b378046188855cb461d/users/581b4589903840f6a7378d9c779bc83c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.120830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d238d779444b378046188855cb461d, user_id=581b4589903840f6a7378d9c779bc83c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:26.124123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:26.129374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 972/1937] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:26.148934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 966/1938] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:25 2022] PUT /identity/v3/projects/e7d238d779444b378046188855cb461d/users/581b4589903840f6a7378d9c779bc83c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:26.152924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:26.154048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:26.161004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:26.259156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bd5a-2e30-43e7-9a15-d9c96fc665e6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:26.273100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9309643-ddc2-4c91-b53b-0f5bf2ec51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:26.273724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9309643-ddc2-4c91-b53b-0f5bf2ec51b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.279398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9309643-ddc2-4c91-b53b-0f5bf2ec51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.279398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9309643-ddc2-4c91-b53b-0f5bf2ec51b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.279398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9309643-ddc2-4c91-b53b-0f5bf2ec51b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:26.279398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9309643-ddc2-4c91-b53b-0f5bf2ec51b6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:26.302275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18d59f-d8d7-4219-954a-6236901c0c17 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:26.309716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 967/1939] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:26.312798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378a9a-213a-484e-bcab-aef4fb32b7ca None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.314167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378a9a-213a-484e-bcab-aef4fb32b7ca None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.314640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1378a9a-213a-484e-bcab-aef4fb32b7ca None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.316287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 968/1940] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:32:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:32:26.317198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378a9a-213a-484e-bcab-aef4fb32b7ca None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:26.356931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1378a9a-213a-484e-bcab-aef4fb32b7ca None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:26.371554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d74e-d395-49c2-bceb-db251cef16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:26.372331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d74e-d395-49c2-bceb-db251cef16f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.372709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d74e-d395-49c2-bceb-db251cef16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.373237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d74e-d395-49c2-bceb-db251cef16f4 admin admin] PATH_INFO: `/v3/projects/e7d238d779444b378046188855cb461d/users/581b4589903840f6a7378d9c779bc83c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.376149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d74e-d395-49c2-bceb-db251cef16f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d238d779444b378046188855cb461d, user_id=581b4589903840f6a7378d9c779bc83c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:26.380687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d74e-d395-49c2-bceb-db251cef16f4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:26.392216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3961e-4f69-46f3-a3ec-38af17d5ad68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:26.393523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3961e-4f69-46f3-a3ec-38af17d5ad68 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.394050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3961e-4f69-46f3-a3ec-38af17d5ad68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.394340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3961e-4f69-46f3-a3ec-38af17d5ad68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.405596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3961e-4f69-46f3-a3ec-38af17d5ad68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:26.409510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3961e-4f69-46f3-a3ec-38af17d5ad68 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:26.411489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 969/1941] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:26 2022] PUT /identity/v3/projects/e7d238d779444b378046188855cb461d/users/581b4589903840f6a7378d9c779bc83c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:26.413142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.413584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.413996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.450062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:26.451282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:26.451686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 973/1942] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:26.453293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.453921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.454454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.504066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] MFA Rules not processed for user `581b4589903840f6a7378d9c779bc83c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:26.505439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:26.664291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 970/1943] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:32:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:26.690047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:26.692617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:26.695423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 974/1944] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:26.706565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:26.709849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:26.719899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ff06d-00b8-49d9-a4a7-74d43cf08b8d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:26.739446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:26.740812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.741429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.742063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.757906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:26.760579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:26.779420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 971/1945] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:26.818687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:26.897068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a64bc-81b9-49a2-bce2-934fbcfadedd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:26.914395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:26.915091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:26.915377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:26.915659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:26.938533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:26.939513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:26.948765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:26.951649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:26.967458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 975/1946] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:27.043278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:27.217334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291ceb-585e-4fae-b72e-e83a78a6a544 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:27.227919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:27.232355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:27.232646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:27.232953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] PATH_INFO: `/v3/projects/357f3226d7904725915751642be9ad5f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:27.235466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=357f3226d7904725915751642be9ad5f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:27.243305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:27.396243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357f3226d7904725915751642be9ad5f', 'request_id': 'req-d4af75c3-5867-4332-8162-e8965a04d70b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.407281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357f3226d7904725915751642be9ad5f', 'request_id': 'req-d4af75c3-5867-4332-8162-e8965a04d70b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.422172 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357f3226d7904725915751642be9ad5f', 'request_id': 'req-d4af75c3-5867-4332-8162-e8965a04d70b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.448106 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] The token cache is being invalidate because project 357f3226d7904725915751642be9ad5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:27.448407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.449472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.450343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:27.451996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:27.452406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 972/1947] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:26 2022] DELETE /identity/v3/projects/357f3226d7904725915751642be9ad5f => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:27.457286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:27.459299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:27.483522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ce6c-75ce-4ece-9653-e861a3c7f98b service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:27.632040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:27.633058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:27.633401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:27.633740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] PATH_INFO: `/v3/projects/865986d03066474aa587b8f9967f279c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:27.635046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] RBAC: Authorizing `identity:delete_project(project_id=865986d03066474aa587b8f9967f279c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:27.637353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:27.640245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af75c3-5867-4332-8162-e8965a04d70b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:27.653807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:27.654808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:27.657251 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:27.657545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] PATH_INFO: `/v3/users/dc576d7e1abd4b32ace11333fdfef8dd` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:27.662143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc576d7e1abd4b32ace11333fdfef8dd)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:27.665130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:27.740368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865986d03066474aa587b8f9967f279c', 'request_id': 'req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.757917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865986d03066474aa587b8f9967f279c', 'request_id': 'req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.775516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865986d03066474aa587b8f9967f279c', 'request_id': 'req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.800446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc576d7e1abd4b32ace11333fdfef8dd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.803953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] The token cache is being invalidate because project 865986d03066474aa587b8f9967f279c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:27.804384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.805391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.805526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:27.812544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 976/1948] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:27 2022] DELETE /identity/v3/projects/865986d03066474aa587b8f9967f279c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:27.814375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:27.817953 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:27.824284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc576d7e1abd4b32ace11333fdfef8dd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.825756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc576d7e1abd4b32ace11333fdfef8dd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.826928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc576d7e1abd4b32ace11333fdfef8dd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.871600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc576d7e1abd4b32ace11333fdfef8dd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:27.918751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 973/1949] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:27 2022] DELETE /identity/v3/users/dc576d7e1abd4b32ace11333fdfef8dd => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:27.946846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:27.948354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:28.007661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b7d60-fe7b-4d68-a252-4202f3b5681c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:28.016227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:28.067057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1b815-0d4a-498e-8b88-2ffc6a1ede9b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:28.071514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:28.072192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:28.072475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:28.072774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:28.078673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:28.109018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:28.112261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:28.113899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:28.114655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] PATH_INFO: `/v3/users/8cefc7dc863f43e99b9da12bc76440f1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:28.116788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cefc7dc863f43e99b9da12bc76440f1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:28.120657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:28.226102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cefc7dc863f43e99b9da12bc76440f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:28.237572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cefc7dc863f43e99b9da12bc76440f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:28.238702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:28.240320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:28.242771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cefc7dc863f43e99b9da12bc76440f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:28.245024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cefc7dc863f43e99b9da12bc76440f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:28.251713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 974/1950] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:28.293381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-27a9ba76-09db-41b0-b797-37bfb5e444e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cefc7dc863f43e99b9da12bc76440f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:28.349790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 977/1951] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:27 2022] DELETE /identity/v3/users/8cefc7dc863f43e99b9da12bc76440f1 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:28.728571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:28.731188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:28.775085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4902bf-6ebc-4186-bf84-0f6b9a296b77 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:28.900889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:28.902028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:28.904463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:28.904463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] PATH_INFO: `/v3/projects/865684d3e7fb4463b323d821f425ac31` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:28.904463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=865684d3e7fb4463b323d821f425ac31)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:28.906679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:28.946362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:29.004995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865684d3e7fb4463b323d821f425ac31', 'request_id': 'req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.017389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865684d3e7fb4463b323d821f425ac31', 'request_id': 'req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.030636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865684d3e7fb4463b323d821f425ac31', 'request_id': 'req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.070657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] The token cache is being invalidate because project 865684d3e7fb4463b323d821f425ac31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:29.071046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.071850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.091858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 975/1952] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:28 2022] DELETE /identity/v3/projects/865684d3e7fb4463b323d821f425ac31 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:29.095950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e602-077d-4bd2-b7b3-dc5003312357 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.096850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e602-077d-4bd2-b7b3-dc5003312357 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.096850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e602-077d-4bd2-b7b3-dc5003312357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.127730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6f98e602-077d-4bd2-b7b3-dc5003312357 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:29.129992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6f98e602-077d-4bd2-b7b3-dc5003312357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:29.232159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.235959 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:29.247497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 978/1953] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:29.268213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7e086-6f20-42b8-9b1a-d412c4c59f49 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.268937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7e086-6f20-42b8-9b1a-d412c4c59f49 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.269055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7e086-6f20-42b8-9b1a-d412c4c59f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.283688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10051-9f0f-489b-9bcc-72a1b2f58dcf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.290644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.291537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.291816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.292090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] PATH_INFO: `/v3/projects/75ea2e8c953345d09457eaa175b2aa49` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.293392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ea2e8c953345d09457eaa175b2aa49)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.298293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-23f7e086-6f20-42b8-9b1a-d412c4c59f49 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:29.299629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-23f7e086-6f20-42b8-9b1a-d412c4c59f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:29.310874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 979/1954] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:29.316995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7e086-6f20-42b8-9b1a-d412c4c59f49 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.318069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.337050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7e086-6f20-42b8-9b1a-d412c4c59f49 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.350656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.353542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.353826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.355943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.357866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:29.358703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.363858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.395666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 980/1955] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:29.396604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.399779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ea2e8c953345d09457eaa175b2aa49', 'request_id': 'req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.409088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ea2e8c953345d09457eaa175b2aa49', 'request_id': 'req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.417261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ea2e8c953345d09457eaa175b2aa49', 'request_id': 'req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.420686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9145ffe-5933-4828-9e96-b252b1eec461 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.435078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] The token cache is being invalidate because project 75ea2e8c953345d09457eaa175b2aa49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:29.435473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.436587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b93ea9cd-9617-49b7-8f0c-aa0c48404cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:29.443062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 976/1956] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:29 2022] DELETE /identity/v3/projects/75ea2e8c953345d09457eaa175b2aa49 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:29.450246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:29.451148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317738-9916-4462-b7dd-c8196d8c8e06 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.451587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317738-9916-4462-b7dd-c8196d8c8e06 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.452069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac317738-9916-4462-b7dd-c8196d8c8e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.477415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ac317738-9916-4462-b7dd-c8196d8c8e06 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:29.478658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ac317738-9916-4462-b7dd-c8196d8c8e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:29.528657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.529480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.529827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.530169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.531016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.533083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.545356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 977/1957] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:29.554415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf489-3b5e-4163-8a9e-1227b20d1389 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.554720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf489-3b5e-4163-8a9e-1227b20d1389 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.555111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bf489-3b5e-4163-8a9e-1227b20d1389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.564776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 981/1958] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:29.565756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.568321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:29.573514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-653bf489-3b5e-4163-8a9e-1227b20d1389 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:29.574697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-653bf489-3b5e-4163-8a9e-1227b20d1389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:29.606505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:29.633517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251da8-b5a2-4790-a1b3-bf7fc5dbf012 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.638106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.638761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 978/1959] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:29.638914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.639129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.639331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.640023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.641991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.643026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bf489-3b5e-4163-8a9e-1227b20d1389 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.652066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bf489-3b5e-4163-8a9e-1227b20d1389 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.657756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.658620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.658973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.659303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.660032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:29.660342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.661967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.663566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 982/1960] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:29.667492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.674309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 979/1961] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:32:29.677892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0134acc-d8cf-4414-85bb-bf8ae8624392 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.678540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.682702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.683618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.683898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.684179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.684947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.686558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.688815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bf297-e91a-4bdc-8bc1-a8bfe5040591 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.694073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.694722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.695008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.695277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.695960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.696664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 983/1962] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:29.698033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.700504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.711986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aee48a-1605-4996-b200-bcd2d15ea231 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.717446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.718113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.718426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.718718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.719481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.721316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.726496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 980/1963] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:29.730695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.731607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 984/1964] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:29.735458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.745518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07555e6e-c995-4ba8-a4c1-14fb2a7cf2e6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.795740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c41d4-a698-4381-b0da-d3428c737cd5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.802852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.803566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.803866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.804078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.804966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.806741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dbf2f-0ca7-45a1-8da9-6d85a377118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.806928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.807646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dbf2f-0ca7-45a1-8da9-6d85a377118b admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.808026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dbf2f-0ca7-45a1-8da9-6d85a377118b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.808241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dbf2f-0ca7-45a1-8da9-6d85a377118b admin admin] PATH_INFO: `/v3/projects/7281c1dbbe794465ae74221ed36d45a7/users/74e909686fce45cfa7f45b5bac7908d1/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.817457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:29.825005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dbf2f-0ca7-45a1-8da9-6d85a377118b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7281c1dbbe794465ae74221ed36d45a7, user_id=74e909686fce45cfa7f45b5bac7908d1, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.828211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dbf2f-0ca7-45a1-8da9-6d85a377118b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:29.840744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 981/1965] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:29.845092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:29.859478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 985/1966] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:29 2022] PUT /identity/v3/projects/7281c1dbbe794465ae74221ed36d45a7/users/74e909686fce45cfa7f45b5bac7908d1/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:29.866822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b465777-f4aa-4e08-8255-dd5848a6c8df admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:29.876030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.876466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.876862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.933770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] MFA Rules not processed for user `74e909686fce45cfa7f45b5bac7908d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:29.936088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:29.991044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:29.992191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:29.992569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:29.992905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:29.994586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:29.997387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.029528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 982/1967] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:30.030922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.067657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b310ef-d23f-4738-8e0a-330bdfb777b1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.072327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 986/1968] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:30.074754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.081293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.081781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.082400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.083549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.085671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.090474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.092276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:30.103966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 983/1969] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:30.109363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.125543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ed12-f66a-463b-8347-9f96e6b7faed admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.131781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92b854-8e2e-413d-b72f-4b3069dac120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.133173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92b854-8e2e-413d-b72f-4b3069dac120 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.133588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92b854-8e2e-413d-b72f-4b3069dac120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.134123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92b854-8e2e-413d-b72f-4b3069dac120 admin admin] PATH_INFO: `/v3/projects/ede6340378e9428581e5a3fc3a1d4ba4/users/aa392615b8a14173aaef02f8498270d3/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.156256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:30.159836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92b854-8e2e-413d-b72f-4b3069dac120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede6340378e9428581e5a3fc3a1d4ba4, user_id=aa392615b8a14173aaef02f8498270d3, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.163728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92b854-8e2e-413d-b72f-4b3069dac120 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.202661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 984/1970] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:30 2022] PUT /identity/v3/projects/ede6340378e9428581e5a3fc3a1d4ba4/users/aa392615b8a14173aaef02f8498270d3/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:30.204590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4d865-915b-4c5b-b953-ddd13297760a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.204892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4d865-915b-4c5b-b953-ddd13297760a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.205747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4d865-915b-4c5b-b953-ddd13297760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.226689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1622b77-e65d-4a94-a531-e01e83012a6e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.250068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bbc4d865-915b-4c5b-b953-ddd13297760a None None] MFA Rules not processed for user `aa392615b8a14173aaef02f8498270d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:30.251436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bbc4d865-915b-4c5b-b953-ddd13297760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:30.318163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.319506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.319976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.320384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.403187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 985/1971] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:30.407651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4d865-915b-4c5b-b953-ddd13297760a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.415120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:30.433384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.434744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.456171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 987/1972] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:30.509970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4d865-915b-4c5b-b953-ddd13297760a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.516363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.517319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.517882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.518409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.520171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.522742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.585358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 986/1973] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:30 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:30.589449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.603469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d9163-fe7b-423a-9c85-b012e3ffd313 service glance] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.675216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.676085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.676919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.677436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.678458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.680870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.727276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 988/1974] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:30 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:30.731548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.747749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6c6e1-89da-4c2d-928e-52600721f63b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.760748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.761457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.761748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.762023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.762770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.767405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.790937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 987/1975] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:30.795318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.811206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113062b9-57b0-4672-a667-a9e2fea39bcd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.821939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.823344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.823723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.824066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] PATH_INFO: `/v3/projects/d175fe6ab7d5489ea7c99a49e3b3f56f/users/2804be24be4a4591869251d8d5181963/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.843533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d175fe6ab7d5489ea7c99a49e3b3f56f, user_id=2804be24be4a4591869251d8d5181963, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.846595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.875130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 989/1976] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:30 2022] PUT /identity/v3/projects/d175fe6ab7d5489ea7c99a49e3b3f56f/users/2804be24be4a4591869251d8d5181963/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:30.880036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.890411 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d46a6-1d62-48d6-9e45-6e893ad51fff admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:30.952816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:30.963970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a00974-8747-4b00-9f72-92603152a81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:30.964707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a00974-8747-4b00-9f72-92603152a81b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:30.965017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a00974-8747-4b00-9f72-92603152a81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:30.965295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a00974-8747-4b00-9f72-92603152a81b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:30.966051 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a00974-8747-4b00-9f72-92603152a81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:30.967700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a00974-8747-4b00-9f72-92603152a81b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:30.978689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 988/1977] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:30.984104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:30.995885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df2645-d12a-4a17-b606-f6237ee38ed1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:31.001221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:31.002161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:31.002598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:31.002879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] PATH_INFO: `/v3/projects/d175fe6ab7d5489ea7c99a49e3b3f56f/users/2804be24be4a4591869251d8d5181963/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:31.004931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d175fe6ab7d5489ea7c99a49e3b3f56f, user_id=2804be24be4a4591869251d8d5181963, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:31.007576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:31.019747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 990/1978] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:30 2022] PUT /identity/v3/projects/d175fe6ab7d5489ea7c99a49e3b3f56f/users/2804be24be4a4591869251d8d5181963/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:31.031266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b53b-d692-4560-a255-8294c5039177 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:31.031756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b53b-d692-4560-a255-8294c5039177 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:31.031909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547b53b-d692-4560-a255-8294c5039177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:31.084891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c547b53b-d692-4560-a255-8294c5039177 None None] MFA Rules not processed for user `2804be24be4a4591869251d8d5181963`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:31.086328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c547b53b-d692-4560-a255-8294c5039177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:31.249025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 989/1979] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:31.262421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:31.265523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:31.343732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d81d7e-543b-4d58-b292-ad95d54e6c73 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:31.347829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:31.348496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:31.348857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:31.349373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:31.359955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:31.361560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:31.388173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 991/1980] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:31.525820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547b53b-d692-4560-a255-8294c5039177 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:31.546592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547b53b-d692-4560-a255-8294c5039177 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:31.557164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e2347-a1b3-41c3-a292-2636086f92c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:31.557979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2347-a1b3-41c3-a292-2636086f92c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:31.558484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2347-a1b3-41c3-a292-2636086f92c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:31.558765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e2347-a1b3-41c3-a292-2636086f92c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:31.663840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2347-a1b3-41c3-a292-2636086f92c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:31.667819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e2347-a1b3-41c3-a292-2636086f92c7 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:31.685429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 990/1981] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:32.124851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:32.203512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:32.226958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd631-3e36-40ef-95e7-ecc995bbf4c1 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:32.237991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:32.238919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:32.239178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:32.239450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] PATH_INFO: `/v3/users/aa392615b8a14173aaef02f8498270d3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:32.240736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa392615b8a14173aaef02f8498270d3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:32.242674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:32.308495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa392615b8a14173aaef02f8498270d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:32.338206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa392615b8a14173aaef02f8498270d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:32.340473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa392615b8a14173aaef02f8498270d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:32.340883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa392615b8a14173aaef02f8498270d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:32.367420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa392615b8a14173aaef02f8498270d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:32.396873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 992/1982] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:32 2022] DELETE /identity/v3/users/aa392615b8a14173aaef02f8498270d3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:32.399574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:32.400175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:32.400443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:32.441185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:32.442560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:32.554726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 991/1983] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:32.561511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:32.563001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:32.651254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1402e3-3e02-4d99-96c2-97a5000c8b3b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:32.655946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:32.656756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:32.657143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:32.657510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:32.672247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:32.675273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:32.690085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 993/1984] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:33.140896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:33.145970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:33.150842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:33.153165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:33.179181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0ff4c-5ee4-41a6-b6de-f16af4c15a94 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:33.200222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:33.201202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:33.201474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:33.201801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] PATH_INFO: `/v3/projects/ede6340378e9428581e5a3fc3a1d4ba4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:33.203642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede6340378e9428581e5a3fc3a1d4ba4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:33.207198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:33.224577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:33.275609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45462aa-70fc-4630-b1c6-88a901a4ebd5 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:33.281449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede6340378e9428581e5a3fc3a1d4ba4', 'request_id': 'req-8ff572f7-c6e4-46df-a96b-9569002bc5d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.294371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede6340378e9428581e5a3fc3a1d4ba4', 'request_id': 'req-8ff572f7-c6e4-46df-a96b-9569002bc5d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.297091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:33.314885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede6340378e9428581e5a3fc3a1d4ba4', 'request_id': 'req-8ff572f7-c6e4-46df-a96b-9569002bc5d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.334598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] The token cache is being invalidate because project ede6340378e9428581e5a3fc3a1d4ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:33.335379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.337029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.343937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 992/1985] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:33 2022] DELETE /identity/v3/projects/ede6340378e9428581e5a3fc3a1d4ba4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:33.348151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:33.349822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:33.351889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:33.353136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:33.353423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:33.353700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:33.355772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:33.430513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff572f7-c6e4-46df-a96b-9569002bc5d5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:33.435991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:33.437935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:33.438468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:33.438854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] PATH_INFO: `/v3/users/2804be24be4a4591869251d8d5181963` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:33.440346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2804be24be4a4591869251d8d5181963)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:33.442543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:33.445650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:33.447234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:33.458975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 994/1986] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:33.517160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2804be24be4a4591869251d8d5181963'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.538698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2804be24be4a4591869251d8d5181963'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.539755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2804be24be4a4591869251d8d5181963'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.540531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2804be24be4a4591869251d8d5181963'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.555365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-512de29f-99c5-4296-872e-ce31d3ae8e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2804be24be4a4591869251d8d5181963'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:33.576567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 993/1987] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:33 2022] DELETE /identity/v3/users/2804be24be4a4591869251d8d5181963 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:34.074467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:34.098074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79a86e-2028-41f8-b6cd-3a6c40a6d66a service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:34.283313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:34.285342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:34.289061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:34.289816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] PATH_INFO: `/v3/projects/d175fe6ab7d5489ea7c99a49e3b3f56f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:34.295356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d175fe6ab7d5489ea7c99a49e3b3f56f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:34.310127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:34.466729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd175fe6ab7d5489ea7c99a49e3b3f56f', 'request_id': 'req-f3cc14a1-f597-4ce7-b818-bb3c602903d7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:34.479806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd175fe6ab7d5489ea7c99a49e3b3f56f', 'request_id': 'req-f3cc14a1-f597-4ce7-b818-bb3c602903d7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:34.492302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd175fe6ab7d5489ea7c99a49e3b3f56f', 'request_id': 'req-f3cc14a1-f597-4ce7-b818-bb3c602903d7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:34.530878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] The token cache is being invalidate because project d175fe6ab7d5489ea7c99a49e3b3f56f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:34.531392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:34.535632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f3cc14a1-f597-4ce7-b818-bb3c602903d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:34.538190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 995/1988] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:34 2022] DELETE /identity/v3/projects/d175fe6ab7d5489ea7c99a49e3b3f56f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:34.542789 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605ad1-e263-4fe5-bce8-858a822d1b9c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:34.543616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605ad1-e263-4fe5-bce8-858a822d1b9c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:34.544035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07605ad1-e263-4fe5-bce8-858a822d1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:34.575383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-07605ad1-e263-4fe5-bce8-858a822d1b9c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:34.577271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-07605ad1-e263-4fe5-bce8-858a822d1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:34.606112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:34.705854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 994/1989] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:34.713792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ae00-17a8-471a-ab94-9cf812dcaf85 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:34.714160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ae00-17a8-471a-ab94-9cf812dcaf85 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:34.714502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38ae00-17a8-471a-ab94-9cf812dcaf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:34.726280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:34.742097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-de38ae00-17a8-471a-ab94-9cf812dcaf85 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:34.744169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-de38ae00-17a8-471a-ab94-9cf812dcaf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:34.772892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 996/1990] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:34.781309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605ad1-e263-4fe5-bce8-858a822d1b9c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:34.796967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07605ad1-e263-4fe5-bce8-858a822d1b9c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:34.811540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:34.812528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:34.813761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:34.814216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:34.815185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:34.815701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:34.817517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:34.840091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 995/1991] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:34.844765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ae00-17a8-471a-ab94-9cf812dcaf85 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:34.857538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38ae00-17a8-471a-ab94-9cf812dcaf85 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:34.865920 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:34.867114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:34.867515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:34.867921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:34.870327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:34.873577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:34.944883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 997/1992] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:34 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:34.948579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:34.962520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7899eb3-4625-4d65-8066-02df68b7a350 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:35.040100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:35.040864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:35.041206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:35.046367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:35.046367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:35.046367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:35.076769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 996/1993] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:34 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:35.079010 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:35.090819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c10270-38a4-4f72-b48b-8c6a8f76f1f8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:35.096680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:35.097494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:35.097775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:35.098049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:35.098783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:35.100452 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:35.115049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 998/1994] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:35.119605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:35.131988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd99ff3-0754-4130-a24e-0e06c76b0be3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:35.139205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f2e73-9a93-40be-ab83-71f2b7fefd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:35.143722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2e73-9a93-40be-ab83-71f2b7fefd5d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:35.144096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2e73-9a93-40be-ab83-71f2b7fefd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:35.144520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2e73-9a93-40be-ab83-71f2b7fefd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:35.145304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f2e73-9a93-40be-ab83-71f2b7fefd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:35.147120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f2e73-9a93-40be-ab83-71f2b7fefd5d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:35.175079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:35.175496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 997/1995] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:35.188447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d6cb9-b2cc-465d-a576-98848221b658 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:35.194644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:35.195704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:35.195991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:35.196320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] PATH_INFO: `/v3/projects/e66d21e98637435182fdb1082c25507f/users/4cde162d128b404186df09a96fb4f088/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:35.226812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66d21e98637435182fdb1082c25507f, user_id=4cde162d128b404186df09a96fb4f088, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:35.231576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:35.259975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 999/1996] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:35 2022] PUT /identity/v3/projects/e66d21e98637435182fdb1082c25507f/users/4cde162d128b404186df09a96fb4f088/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:35.271841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:35.272202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:35.272563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:35.304043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] MFA Rules not processed for user `4cde162d128b404186df09a96fb4f088`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:35.307037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:35.412389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 998/1997] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:35.426054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:35.428965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:35.580647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da786b-5e18-4053-bf7b-fd0ba7367f65 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:35.589389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0079b-87ef-4910-8b50-4fa8caee9483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:35.590162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0079b-87ef-4910-8b50-4fa8caee9483 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:35.590444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0079b-87ef-4910-8b50-4fa8caee9483 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:35.590828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0079b-87ef-4910-8b50-4fa8caee9483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:35.616986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0079b-87ef-4910-8b50-4fa8caee9483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:35.618726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0079b-87ef-4910-8b50-4fa8caee9483 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:35.638882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1000/1998] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:36.488212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:36.489947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:36.504149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:36.562406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995f8a-26d7-44fa-ace7-1ff9daef4654 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:36.570689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:36.571855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:36.572643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:36.572643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] PATH_INFO: `/v3/users/f464f2e2879d4eabb53463e7b37afe20` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:36.574390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f464f2e2879d4eabb53463e7b37afe20)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:36.577492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:36.644013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f464f2e2879d4eabb53463e7b37afe20'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:36.652640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f464f2e2879d4eabb53463e7b37afe20'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:36.653821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f464f2e2879d4eabb53463e7b37afe20'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:36.654450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f464f2e2879d4eabb53463e7b37afe20'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:36.672461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f464f2e2879d4eabb53463e7b37afe20'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:36.697107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 999/1999] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:36 2022] DELETE /identity/v3/users/f464f2e2879d4eabb53463e7b37afe20 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:36.701459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:36.702259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:36.702690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:36.722962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:36.724202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:36.853869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1001/2000] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:36.865875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:36.867593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:36.984995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6787f30-3cbb-4e17-851e-629d19c50192 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:37.003369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:37.004060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:37.004415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:37.004832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:37.031435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:37.032970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:37.068486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1000/2001] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:37.566026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:37.567663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:37.580493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670e0ba-3dee-4fb3-acaa-5958f41cf701 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:37.585121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:37.586044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:37.586323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:37.586611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] PATH_INFO: `/v3/projects/2325a52a64aa44aead308e9cf5f1dec4` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:37.587835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2325a52a64aa44aead308e9cf5f1dec4)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:37.589805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:37.648410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:37.657588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2325a52a64aa44aead308e9cf5f1dec4', 'request_id': 'req-da85cfdb-5c58-4dab-8cb1-30237f9b1901'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.669959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2325a52a64aa44aead308e9cf5f1dec4', 'request_id': 'req-da85cfdb-5c58-4dab-8cb1-30237f9b1901'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.682638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2325a52a64aa44aead308e9cf5f1dec4', 'request_id': 'req-da85cfdb-5c58-4dab-8cb1-30237f9b1901'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.693978 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] The token cache is being invalidate because project 2325a52a64aa44aead308e9cf5f1dec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:37.694240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.694920 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.696501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1002/2002] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:37 2022] DELETE /identity/v3/projects/2325a52a64aa44aead308e9cf5f1dec4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:37.700437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:37.711878 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526d751-5887-4e04-bb38-2a7fa72f1089 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:37.744262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:37.775442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:37.776329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:37.776604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:37.776905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] PATH_INFO: `/v3/users/e081c3aeca9949ac94ed1cf581f832e0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:37.778136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=e081c3aeca9949ac94ed1cf581f832e0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:37.780103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:37.833601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e081c3aeca9949ac94ed1cf581f832e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.840310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e081c3aeca9949ac94ed1cf581f832e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.841008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e081c3aeca9949ac94ed1cf581f832e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.841622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e081c3aeca9949ac94ed1cf581f832e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.855040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e081c3aeca9949ac94ed1cf581f832e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:37.870897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1001/2003] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:37 2022] DELETE /identity/v3/users/e081c3aeca9949ac94ed1cf581f832e0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:38.170388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:38.171925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:38.192444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85cfdb-5c58-4dab-8cb1-30237f9b1901 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:38.265481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:38.266401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:38.266684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:38.266961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] PATH_INFO: `/v3/projects/f0ee0c0c799645f3bab15bf61b25584c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:38.268423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ee0c0c799645f3bab15bf61b25584c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:38.270388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:38.327417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ee0c0c799645f3bab15bf61b25584c', 'request_id': 'req-5431239a-ea69-4555-bc78-e95a9d85c4f9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.334509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ee0c0c799645f3bab15bf61b25584c', 'request_id': 'req-5431239a-ea69-4555-bc78-e95a9d85c4f9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.342818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ee0c0c799645f3bab15bf61b25584c', 'request_id': 'req-5431239a-ea69-4555-bc78-e95a9d85c4f9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.353500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] The token cache is being invalidate because project f0ee0c0c799645f3bab15bf61b25584c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:38.353804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.354420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.355961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1003/2004] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:38 2022] DELETE /identity/v3/projects/f0ee0c0c799645f3bab15bf61b25584c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:38.360211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:38.362014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:38.376382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53e546-97ea-4575-954a-fcfabb4999ce admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:38.460228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:38.464047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:38.464315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:38.464586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] PATH_INFO: `/v3/users/581b4589903840f6a7378d9c779bc83c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:38.466719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581b4589903840f6a7378d9c779bc83c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:38.468669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:38.541029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581b4589903840f6a7378d9c779bc83c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.553875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:38.556333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581b4589903840f6a7378d9c779bc83c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.557519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581b4589903840f6a7378d9c779bc83c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.558475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581b4589903840f6a7378d9c779bc83c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.578308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d654b656-0ec2-4c8c-ac46-90fb350891b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581b4589903840f6a7378d9c779bc83c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:38.608849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1002/2005] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:38 2022] DELETE /identity/v3/users/581b4589903840f6a7378d9c779bc83c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:38.990575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:38.992039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:39.013872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431239a-ea69-4555-bc78-e95a9d85c4f9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.106976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:39.117378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.118428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.119032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.119483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] PATH_INFO: `/v3/projects/e7d238d779444b378046188855cb461d` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.122179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d238d779444b378046188855cb461d)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.124945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.182445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d238d779444b378046188855cb461d', 'request_id': 'req-6827aee9-f34e-430a-8840-489a67c721b0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.188899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d238d779444b378046188855cb461d', 'request_id': 'req-6827aee9-f34e-430a-8840-489a67c721b0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.198417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d238d779444b378046188855cb461d', 'request_id': 'req-6827aee9-f34e-430a-8840-489a67c721b0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.213662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] The token cache is being invalidate because project e7d238d779444b378046188855cb461d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:39.213954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.214622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6827aee9-f34e-430a-8840-489a67c721b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.216459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1004/2006] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:38 2022] DELETE /identity/v3/projects/e7d238d779444b378046188855cb461d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:39.223150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796883f4-7818-486d-acea-2c08eb0b843c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.223691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796883f4-7818-486d-acea-2c08eb0b843c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.223691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796883f4-7818-486d-acea-2c08eb0b843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.243648 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-796883f4-7818-486d-acea-2c08eb0b843c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:39.245085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-796883f4-7818-486d-acea-2c08eb0b843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:39.328016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1003/2007] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:39.338493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8d2f5-212c-45cb-826d-db992ca87df4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.338961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8d2f5-212c-45cb-826d-db992ca87df4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.339355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8d2f5-212c-45cb-826d-db992ca87df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.374137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-76e8d2f5-212c-45cb-826d-db992ca87df4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:39.375529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-76e8d2f5-212c-45cb-826d-db992ca87df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:39.389868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1005/2008] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:39.391404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796883f4-7818-486d-acea-2c08eb0b843c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:39.402871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796883f4-7818-486d-acea-2c08eb0b843c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.410131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.410817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.411118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.411390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.412134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:39.412439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.414121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.431146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1004/2009] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:39.436287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8d2f5-212c-45cb-826d-db992ca87df4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:39.446704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8d2f5-212c-45cb-826d-db992ca87df4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.452811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.453523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.453798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.454071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.454768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.456946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.486863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1006/2010] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:39.491350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:39.508220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a688eef-f1f8-498e-8190-cc8fd1f8b9e3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.589065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.589841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.590272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.590560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.591311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.593490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.654217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1005/2011] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:39 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:39.659040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:39.686076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:39.689426 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:39.691395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d76d1c-24e2-439b-a860-bcc4e9f757f5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.708863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.709845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.710646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.717680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.719208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.721270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.736698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1007/2012] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:39.738001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:39.739174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abeee55-fc4f-4521-824b-f44be32bd295 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.748203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.749974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.750479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.750975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] PATH_INFO: `/v3/users/b27efd2d5c0e4b09b795e290911db777` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.753280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27efd2d5c0e4b09b795e290911db777)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.760554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.761402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35327b-e0cd-4e97-bc50-6f8b2b996158 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.773426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.774530 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.775040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.775514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.776446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.778518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.814167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1008/2013] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:39.815729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:39.829441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4bec-863f-444c-9c86-795eca9cee35 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:39.834981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97944c-7b92-42cf-b911-0941cf2e00ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:39.836191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97944c-7b92-42cf-b911-0941cf2e00ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.836700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97944c-7b92-42cf-b911-0941cf2e00ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.837205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97944c-7b92-42cf-b911-0941cf2e00ac admin admin] PATH_INFO: `/v3/projects/1262ff1c107749f1969779d47c6241b6/users/aa9e39ca10f6458d92a106d1a9799d21/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.845754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:39.856851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97944c-7b92-42cf-b911-0941cf2e00ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1262ff1c107749f1969779d47c6241b6, user_id=aa9e39ca10f6458d92a106d1a9799d21, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:39.857226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27efd2d5c0e4b09b795e290911db777'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.862233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97944c-7b92-42cf-b911-0941cf2e00ac admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:39.875931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27efd2d5c0e4b09b795e290911db777'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.876684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27efd2d5c0e4b09b795e290911db777'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.877784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27efd2d5c0e4b09b795e290911db777'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.890040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1009/2014] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:39 2022] PUT /identity/v3/projects/1262ff1c107749f1969779d47c6241b6/users/aa9e39ca10f6458d92a106d1a9799d21/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:39.902220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-146f3ab0-3dc9-4c7c-95a0-11f9f79d9d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27efd2d5c0e4b09b795e290911db777'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:39.904908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.905440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.905975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.935418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1006/2015] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:39 2022] DELETE /identity/v3/users/b27efd2d5c0e4b09b795e290911db777 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:39.940450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:39.940806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:39.941191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:39.947417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] MFA Rules not processed for user `aa9e39ca10f6458d92a106d1a9799d21`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:39.949671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:39.972267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:39.974589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:40.049310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1007/2016] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:40.060671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.063192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:40.090506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1010/2017] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:40.097273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.099028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:40.109174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:40.116429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3c3b-14e0-48f6-a0fb-04753e2cc9e3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.126011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.126011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.126011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.128557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.128557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.131260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.158822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687aadd4-c179-4562-98c9-b576e6822596 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.166302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.167110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.167502 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.167827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.182658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.184409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.193855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1011/2018] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:40 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:40.194989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.197437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1008/2019] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:40.290052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee658e-0119-42ee-8365-7c7f7b9a0678 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.290052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.290052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.290052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.290600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.290600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.291392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.337659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1012/2020] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:40 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:40.341818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.359200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867406f-7644-4623-81e6-4f50e3e1e6dc service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.375131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.375938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.377739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.381919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.382965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.384825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.416866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1009/2021] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:40.418819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.433265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3053d70-ef2e-4cbd-991e-44ef77bb78a7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.440566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.443613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.444242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.444731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] PATH_INFO: `/v3/projects/77f51ea734544455a6d8aa988d6d6c22/users/1e44974325d448ebb93c964d22e7530d/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.466922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f51ea734544455a6d8aa988d6d6c22, user_id=1e44974325d448ebb93c964d22e7530d, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.470219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.491058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1013/2022] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:40 2022] PUT /identity/v3/projects/77f51ea734544455a6d8aa988d6d6c22/users/1e44974325d448ebb93c964d22e7530d/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:40.495367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.506865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7a846-83c4-453a-99ea-696cb3a37cb8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.567227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:40.594631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbed01-7433-4e3e-af09-5fda67d7b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.595321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbed01-7433-4e3e-af09-5fda67d7b52b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.595657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbed01-7433-4e3e-af09-5fda67d7b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.595940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbed01-7433-4e3e-af09-5fda67d7b52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.596798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbed01-7433-4e3e-af09-5fda67d7b52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.598691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbed01-7433-4e3e-af09-5fda67d7b52b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.612894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1010/2023] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:40.617021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.631162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceeb57-b1b8-473c-b8c9-67e24dc0ab88 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.636658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.637757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.638122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.638527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] PATH_INFO: `/v3/projects/77f51ea734544455a6d8aa988d6d6c22/users/1e44974325d448ebb93c964d22e7530d/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.641232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f51ea734544455a6d8aa988d6d6c22, user_id=1e44974325d448ebb93c964d22e7530d, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.644860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.657961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1014/2024] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:40 2022] PUT /identity/v3/projects/77f51ea734544455a6d8aa988d6d6c22/users/1e44974325d448ebb93c964d22e7530d/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:40.670363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.670800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.671589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.708706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] MFA Rules not processed for user `1e44974325d448ebb93c964d22e7530d`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:40.710488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:40.759811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.762026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:40.832075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1011/2025] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:40.843582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.844807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:40.862221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818725f-0f4e-4851-af4a-35b738c7791b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.873558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:40.874471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:40.874757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:40.875057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] PATH_INFO: `/v3/projects/3e01a4d25ec14f89918bd93c30f4f007` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:40.876482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e01a4d25ec14f89918bd93c30f4f007)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:40.878554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:40.927458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8f268-71a7-469a-8dc7-2ffe5f098bef None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:40.930624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:40.945329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e01a4d25ec14f89918bd93c30f4f007', 'request_id': 'req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:40.952882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e01a4d25ec14f89918bd93c30f4f007', 'request_id': 'req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:40.964774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e01a4d25ec14f89918bd93c30f4f007', 'request_id': 'req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:40.988105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] The token cache is being invalidate because project 3e01a4d25ec14f89918bd93c30f4f007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:40.988437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:40.989901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:40.991473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1015/2026] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:40 2022] DELETE /identity/v3/projects/3e01a4d25ec14f89918bd93c30f4f007 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:40.995490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:40.996930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.008205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:41.008961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:41.009253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:41.009528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:41.011347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.083544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:41.103717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3b6e7-2b2e-4f56-9574-cd2f2eb81dcf admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:41.107954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:41.109544 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:41.110119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:41.111790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:41.112103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:41.112556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] PATH_INFO: `/v3/users/5b24d7a254d34e7b9630409754bfe52b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:41.114077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b24d7a254d34e7b9630409754bfe52b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:41.116813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:41.124476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1012/2027] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:41.182749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b24d7a254d34e7b9630409754bfe52b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.190917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b24d7a254d34e7b9630409754bfe52b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.191858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b24d7a254d34e7b9630409754bfe52b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.192754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b24d7a254d34e7b9630409754bfe52b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.209030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b24d7a254d34e7b9630409754bfe52b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.232383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1016/2028] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:40 2022] DELETE /identity/v3/users/5b24d7a254d34e7b9630409754bfe52b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:41.240344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:41.241849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.256293 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc3ec1-b3e7-4221-b97f-325e19101268 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:41.319414 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:41.319985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:41.320273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:41.320554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:41.323250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.407494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:41.409494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:41.419905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1013/2029] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:41.537004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:41.538489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.611175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:41.642173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:41.644059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.650336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d62d7-5d70-4588-8155-347acc272bce admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:41.665096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:41.666312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:41.667321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:41.667812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] PATH_INFO: `/v3/users/4cde162d128b404186df09a96fb4f088` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:41.670363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cde162d128b404186df09a96fb4f088)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:41.673530 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:41.676645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d28d9-00c5-4bd8-af72-964a5a5ba83e service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:41.682358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:41.683445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:41.683915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:41.684355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] PATH_INFO: `/v3/projects/1e9ab6b1d076477eaf0a8c2dd1f453de` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:41.685989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9ab6b1d076477eaf0a8c2dd1f453de)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:41.688674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:41.750489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cde162d128b404186df09a96fb4f088'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.764605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cde162d128b404186df09a96fb4f088'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.766021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cde162d128b404186df09a96fb4f088'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.770359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cde162d128b404186df09a96fb4f088'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.778032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9ab6b1d076477eaf0a8c2dd1f453de', 'request_id': 'req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.795534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-084d2e8a-484e-4a77-8dd2-ba4e85e05513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cde162d128b404186df09a96fb4f088'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.822679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9ab6b1d076477eaf0a8c2dd1f453de', 'request_id': 'req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.834715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9ab6b1d076477eaf0a8c2dd1f453de', 'request_id': 'req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.842340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1017/2030] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:41 2022] DELETE /identity/v3/users/4cde162d128b404186df09a96fb4f088 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:41.847710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:41.848004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:41.848281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:41.854142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] The token cache is being invalidate because project 1e9ab6b1d076477eaf0a8c2dd1f453de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:41.854521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.856355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f94cb4cf-ecc8-490d-a0cb-e0201271d1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:41.864405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1014/2031] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:41 2022] DELETE /identity/v3/projects/1e9ab6b1d076477eaf0a8c2dd1f453de => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:41.878968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f637-24e2-4ba7-9fe6-d0dc78828334 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:41.879238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f637-24e2-4ba7-9fe6-d0dc78828334 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:41.879508 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821f637-24e2-4ba7-9fe6-d0dc78828334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:41.907041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:41.907041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.948875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1821f637-24e2-4ba7-9fe6-d0dc78828334 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:41.950201 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1821f637-24e2-4ba7-9fe6-d0dc78828334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:41.981202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:42.031099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1018/2032] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:42.039584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.041906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:42.089653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1015/2033] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:42.125758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bde57-b857-49a9-be3c-60967ee8ebe1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.126034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bde57-b857-49a9-be3c-60967ee8ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.126294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bde57-b857-49a9-be3c-60967ee8ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.160645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b34829-03d0-4738-8f34-87b52092d56b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.165633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a92bde57-b857-49a9-be3c-60967ee8ebe1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:42.167114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a92bde57-b857-49a9-be3c-60967ee8ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:42.177057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.178021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.178313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.178640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.181990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1016/2034] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:42.182744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bde57-b857-49a9-be3c-60967ee8ebe1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.191267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.194954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.195076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bde57-b857-49a9-be3c-60967ee8ebe1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.197999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.198795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.199545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.199545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.200252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:42.200567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.204908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.205156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1019/2035] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:42.228296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1017/2036] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:32:42.229552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.235755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:42.239899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610232c0-09b9-499a-bf63-7ce55a7e0e42 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.249618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.250707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.251168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.251879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.252815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.256190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.299279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1020/2037] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:42 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:42.303798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.321340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eb6a6-1874-44d7-a37b-502c956400ff admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.414532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.415463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.416839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.417297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.418191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.421038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.452786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1018/2038] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:42 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:42.456349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.467178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1cfef-417d-4788-acdf-cf589a178669 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.481560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.482621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.482980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.483361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.484212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.486112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.507191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1021/2039] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:42.513132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.526171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae516b1-4764-4756-aae9-03c0da8b80e0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.536646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fd099-dd31-4e05-8da0-b30e50a20429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.537641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fd099-dd31-4e05-8da0-b30e50a20429 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.537966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fd099-dd31-4e05-8da0-b30e50a20429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.538271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fd099-dd31-4e05-8da0-b30e50a20429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.539011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fd099-dd31-4e05-8da0-b30e50a20429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.541214 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fd099-dd31-4e05-8da0-b30e50a20429 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.562288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1019/2040] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:42.562677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.578738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9fdbb9-72a9-48b7-ab3f-02627d227870 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.583913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.585163 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.585450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.585728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] PATH_INFO: `/v3/projects/50367127d6c84933bf47166908cdd691/users/fbbd331c17824072b5d20120218c2d43/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.603797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50367127d6c84933bf47166908cdd691, user_id=fbbd331c17824072b5d20120218c2d43, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.606936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.645342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1022/2041] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:42 2022] PUT /identity/v3/projects/50367127d6c84933bf47166908cdd691/users/fbbd331c17824072b5d20120218c2d43/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:42.652750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491557-cb7c-442b-aa2d-696eb39aba85 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.652750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491557-cb7c-442b-aa2d-696eb39aba85 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.652750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491557-cb7c-442b-aa2d-696eb39aba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.691279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0d491557-cb7c-442b-aa2d-696eb39aba85 None None] MFA Rules not processed for user `fbbd331c17824072b5d20120218c2d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:42.692292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0d491557-cb7c-442b-aa2d-696eb39aba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:42.775311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1020/2042] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:42.780298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.870477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fa063-3e3e-4871-9feb-48de77ea9ac3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.880167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:42.881436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:42.882541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:42.883001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:42.883604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:42.885616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:42.927664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1023/2043] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:42 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:42.935227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d491557-cb7c-442b-aa2d-696eb39aba85 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.949367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d491557-cb7c-442b-aa2d-696eb39aba85 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:42.955862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:42.970691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:42.972917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:43.121356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.122062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.122345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.122620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.123326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.125321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.163264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1021/2044] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:42 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:43.164192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.168797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109eb25-24c3-4920-b09a-5299953fa99f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.181291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.182208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.182496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.182831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] PATH_INFO: `/v3/projects/e66d21e98637435182fdb1082c25507f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.185659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66d21e98637435182fdb1082c25507f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.196578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.196820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d91a0e-1d9f-4392-a8a9-0fa89725d659 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.218346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.219215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.219357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.219586 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.220326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.222684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.238452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1022/2045] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:43.243564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.260885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d23f3-7208-4d31-8e17-dee2bfd7e842 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.266584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.268195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.269049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.269579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] PATH_INFO: `/v3/projects/84b84e9308b54add98998ec13c82ea16/users/fbbd3fd90da242819e607f8c2587136c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.295348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b84e9308b54add98998ec13c82ea16, user_id=fbbd3fd90da242819e607f8c2587136c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.298827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.313282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:43.323341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1023/2046] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:43 2022] PUT /identity/v3/projects/84b84e9308b54add98998ec13c82ea16/users/fbbd3fd90da242819e607f8c2587136c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:43.327767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.340748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66d21e98637435182fdb1082c25507f', 'request_id': 'req-18eb9d89-de64-4965-8e25-e327484ac9d4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:43.354915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66d21e98637435182fdb1082c25507f', 'request_id': 'req-18eb9d89-de64-4965-8e25-e327484ac9d4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:43.372111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66d21e98637435182fdb1082c25507f', 'request_id': 'req-18eb9d89-de64-4965-8e25-e327484ac9d4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:43.393986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] The token cache is being invalidate because project e66d21e98637435182fdb1082c25507f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:43.394792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:43.395594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-18eb9d89-de64-4965-8e25-e327484ac9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:43.397824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1024/2047] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:42 2022] DELETE /identity/v3/projects/e66d21e98637435182fdb1082c25507f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:43.403385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10180490-5d6a-465d-a274-831df68ec6ea None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.405174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10180490-5d6a-465d-a274-831df68ec6ea None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.405578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10180490-5d6a-465d-a274-831df68ec6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.446031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-10180490-5d6a-465d-a274-831df68ec6ea None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:43.447870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-10180490-5d6a-465d-a274-831df68ec6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:43.481822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3f8cf-312c-4f3c-9067-d1a834569026 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.488563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.489672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.490133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.490563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.491631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.495023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.509725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1024/2048] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:43.514569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.516926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:43.532381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b41f6-0de0-4317-9402-44f93a5705f9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.543797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703e1b4-ea6e-48cb-a9b6-5d5a54d1d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.544860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e1b4-ea6e-48cb-a9b6-5d5a54d1d524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.545202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e1b4-ea6e-48cb-a9b6-5d5a54d1d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.545416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703e1b4-ea6e-48cb-a9b6-5d5a54d1d524 admin admin] PATH_INFO: `/v3/projects/84b84e9308b54add98998ec13c82ea16/users/fbbd3fd90da242819e607f8c2587136c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.547477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703e1b4-ea6e-48cb-a9b6-5d5a54d1d524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b84e9308b54add98998ec13c82ea16, user_id=fbbd3fd90da242819e607f8c2587136c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.552617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703e1b4-ea6e-48cb-a9b6-5d5a54d1d524 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.553636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1025/2049] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:43.561917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa24820-4ff1-477e-ae2e-0a980a62ce23 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.565103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa24820-4ff1-477e-ae2e-0a980a62ce23 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.565739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa24820-4ff1-477e-ae2e-0a980a62ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.572836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1025/2050] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:43 2022] PUT /identity/v3/projects/84b84e9308b54add98998ec13c82ea16/users/fbbd3fd90da242819e607f8c2587136c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:43.585846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34797-c6b4-4fdc-832d-eafd1e037a09 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.586145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34797-c6b4-4fdc-832d-eafd1e037a09 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.586398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa34797-c6b4-4fdc-832d-eafd1e037a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.602055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-dfa24820-4ff1-477e-ae2e-0a980a62ce23 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:43.604849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dfa24820-4ff1-477e-ae2e-0a980a62ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:43.621366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6aa34797-c6b4-4fdc-832d-eafd1e037a09 None None] MFA Rules not processed for user `fbbd3fd90da242819e607f8c2587136c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:43.622865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6aa34797-c6b4-4fdc-832d-eafd1e037a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:43.682406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:43.708549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1026/2051] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:43.713490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa24820-4ff1-477e-ae2e-0a980a62ce23 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.738809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa24820-4ff1-477e-ae2e-0a980a62ce23 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.744036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.744770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.745047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.745357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.746129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:43.746439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.748318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.762260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1026/2052] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:43.774286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1027/2053] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:43.775869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa34797-c6b4-4fdc-832d-eafd1e037a09 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.780939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.783203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:43.791341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa34797-c6b4-4fdc-832d-eafd1e037a09 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.797707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:43.798641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:43.799396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:43.799824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:43.801748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:43.804420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:43.854783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1027/2054] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:43 2022] POST /identity/v3/projects => generated 359 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:43.859252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:43.887305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bfc13-5497-447a-89ba-f0f040abcaaa admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:43.893525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:44.000920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f316-85e5-41f8-aa48-27ee9366a076 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.007775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.011632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.012548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.012672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.012836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.013084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.013193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.013477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.013856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.016252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.046636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1028/2055] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:43 2022] POST /identity/v3/users => generated 280 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:44.052011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.086108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f38e9-a8e7-4312-97c2-e1ed9da33f31 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.090989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.091658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.091941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.092205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.093021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.094616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.104451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.108773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1029/2056] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:44.108924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.111477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.121478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab855169-28c0-46ee-8be8-001bcea262f9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.125376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1028/2057] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:44.137467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecbdb7-5ede-47c1-b9b6-e6d1827267e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.138822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecbdb7-5ede-47c1-b9b6-e6d1827267e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.139092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecbdb7-5ede-47c1-b9b6-e6d1827267e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.139364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecbdb7-5ede-47c1-b9b6-e6d1827267e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.140098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecbdb7-5ede-47c1-b9b6-e6d1827267e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.141742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecbdb7-5ede-47c1-b9b6-e6d1827267e7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.164320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1030/2058] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:44.168707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.181671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f938e-5637-4b5e-b013-b4859e376b85 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.191005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.191998 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.192320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.192524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] PATH_INFO: `/v3/projects/d288927d8d404ce3a47b839777c40fab/users/c36b3f85c59e4fe78ae8537da7069ab6/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.234937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d288927d8d404ce3a47b839777c40fab, user_id=c36b3f85c59e4fe78ae8537da7069ab6, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.238440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.265503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1029/2059] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:44 2022] PUT /identity/v3/projects/d288927d8d404ce3a47b839777c40fab/users/c36b3f85c59e4fe78ae8537da7069ab6/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:44.279947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.279947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.279947 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.312261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] MFA Rules not processed for user `c36b3f85c59e4fe78ae8537da7069ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:44.313836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:44.408560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1031/2060] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:44.442722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.505130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba0143-cae8-485f-80db-154b45ba37a1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.507521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.509038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.509164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:44.509694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.509974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.510256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.516613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:44.520009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.521703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.531761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1030/2061] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:44 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:44.542206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.583571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc169-0e02-44fd-9d79-118c738725ee None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.584519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:44.588857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.589752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.590032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.590308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] PATH_INFO: `/v3/users/aa9e39ca10f6458d92a106d1a9799d21` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.591952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9e39ca10f6458d92a106d1a9799d21)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.593952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.608484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7241-b854-451f-a271-e1263765bc03 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.613511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbbd3fd90da242819e607f8c2587136c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84b84e9308b54add98998ec13c82ea16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.614204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.614488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.614774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.615506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:44.615836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.617499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.630193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1031/2062] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:32:44.631159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.647442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dedbd-7939-4bee-992c-cdcf7705de43 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.648174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9e39ca10f6458d92a106d1a9799d21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.653035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.653962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.654240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.654521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] PATH_INFO: `/v3/users/c36b3f85c59e4fe78ae8537da7069ab6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.655832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c36b3f85c59e4fe78ae8537da7069ab6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.655944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9e39ca10f6458d92a106d1a9799d21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.656599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9e39ca10f6458d92a106d1a9799d21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.657259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9e39ca10f6458d92a106d1a9799d21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.658013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.669574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9e39ca10f6458d92a106d1a9799d21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.689728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1032/2063] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:44 2022] DELETE /identity/v3/users/aa9e39ca10f6458d92a106d1a9799d21 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:44.689728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.689728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:44.711870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c36b3f85c59e4fe78ae8537da7069ab6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.719210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c36b3f85c59e4fe78ae8537da7069ab6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.719993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c36b3f85c59e4fe78ae8537da7069ab6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.720791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c36b3f85c59e4fe78ae8537da7069ab6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.732802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9601a615-8520-49d1-bb7f-6966cea4d775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c36b3f85c59e4fe78ae8537da7069ab6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:44.759846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1032/2064] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:44 2022] DELETE /identity/v3/users/c36b3f85c59e4fe78ae8537da7069ab6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:44.761488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd36227-49aa-483d-a8bd-bdfaa5ac0e89 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.761801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd36227-49aa-483d-a8bd-bdfaa5ac0e89 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.762056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd36227-49aa-483d-a8bd-bdfaa5ac0e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.768204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af387b9-2cbc-4959-8549-3072a707a563 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:44.782473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9fd36227-49aa-483d-a8bd-bdfaa5ac0e89 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:44.785805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9fd36227-49aa-483d-a8bd-bdfaa5ac0e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:44.808666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:44.853758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbbd3fd90da242819e607f8c2587136c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84b84e9308b54add98998ec13c82ea16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:44.854449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.854736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.855592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.856159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:44.858290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:44.900579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1033/2065] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:44.902040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:44.903036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:44.903036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:44.912070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1033/2066] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:44 2022] POST /identity/v3/projects => generated 354 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:44.913854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:44.916589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:44.927738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:44.929378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:44.989256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:44.997950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629011-2b75-49f0-887a-8e7589e20015 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:45.004487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:45.005239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.005655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.005930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.016394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1034/2067] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:45.018099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:45.020502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:45.036122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:45.038006 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:45.050649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1034/2068] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:45.052155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:45.067962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5ff60-8993-4c0a-b0d8-6d0b03b3739a service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:45.075572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:45.076252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.076514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.076809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.093570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:45.095102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:45.117258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1035/2069] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:45.134099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868b4ec-a33c-4807-8cf1-270d24072126 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:45.139525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbbd3fd90da242819e607f8c2587136c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84b84e9308b54add98998ec13c82ea16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:45.140335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.140837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.141014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.142092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:45.142198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:45.144994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:45.161149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1035/2070] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:45.201892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:45.215393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef70b1-2253-4f32-80d1-e8dc00cc60c6 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:45.223363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbbd3fd90da242819e607f8c2587136c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84b84e9308b54add98998ec13c82ea16', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:45.224572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.224894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.225270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] PATH_INFO: `/v3/projects/efcc5d8160924851b7c78436226c5831` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.226654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorizing `identity:delete_project(project_id=efcc5d8160924851b7c78436226c5831)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:45.229347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:45.327791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcc5d8160924851b7c78436226c5831', 'request_id': 'req-0cc656e2-c000-4962-9499-96b73fcc83a8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.335701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcc5d8160924851b7c78436226c5831', 'request_id': 'req-0cc656e2-c000-4962-9499-96b73fcc83a8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.341657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcc5d8160924851b7c78436226c5831', 'request_id': 'req-0cc656e2-c000-4962-9499-96b73fcc83a8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.358134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] The token cache is being invalidate because project efcc5d8160924851b7c78436226c5831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:45.358649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.359444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.361423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1036/2071] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:45 2022] DELETE /identity/v3/projects/efcc5d8160924851b7c78436226c5831 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:45.602359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:45.604905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:45.620967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc940fa-7d72-45c6-bedd-099c359c6f9c tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:45.656505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:45.660219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:45.693987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:45.695789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.696143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.696546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] PATH_INFO: `/v3/users/fbbd331c17824072b5d20120218c2d43` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.698004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbd331c17824072b5d20120218c2d43)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:45.699298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:45.699959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:45.741478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc656e2-c000-4962-9499-96b73fcc83a8 tempest-VolumeQuotaClassesTest-1661621286 tempest-VolumeQuotaClassesTest-1661621286-project-admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:45.748121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:45.749222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.749518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.749791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] PATH_INFO: `/v3/projects/d288927d8d404ce3a47b839777c40fab` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.751076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d288927d8d404ce3a47b839777c40fab)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:45.754136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:45.757349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbd331c17824072b5d20120218c2d43'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.764775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbd331c17824072b5d20120218c2d43'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.765586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbd331c17824072b5d20120218c2d43'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.766357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbd331c17824072b5d20120218c2d43'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.780310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbd331c17824072b5d20120218c2d43'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.784041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:45.800699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1036/2072] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:45 2022] DELETE /identity/v3/users/fbbd331c17824072b5d20120218c2d43 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:45.801970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:45.803360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:45.807871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd288927d8d404ce3a47b839777c40fab', 'request_id': 'req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.814421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd288927d8d404ce3a47b839777c40fab', 'request_id': 'req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.820763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd288927d8d404ce3a47b839777c40fab', 'request_id': 'req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.834458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] The token cache is being invalidate because project d288927d8d404ce3a47b839777c40fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:45.834742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.835845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4dbcd668-b9c3-4893-9b2e-e6d50cc45b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.837670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1037/2073] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:45 2022] DELETE /identity/v3/projects/d288927d8d404ce3a47b839777c40fab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:45.839035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.839324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.839601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.878066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:45.880615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:45.883550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7796204-7e37-4be0-89fd-cb54c08db419 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:45.888422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:45.889380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:45.889664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:45.889949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] PATH_INFO: `/v3/projects/1262ff1c107749f1969779d47c6241b6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:45.890794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1038/2074] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:45.894004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1262ff1c107749f1969779d47c6241b6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:45.896003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:45.905900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:45.907494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:45.980143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1262ff1c107749f1969779d47c6241b6', 'request_id': 'req-f1502111-a619-454f-a64d-642d450f0e4d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:45.988068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1262ff1c107749f1969779d47c6241b6', 'request_id': 'req-f1502111-a619-454f-a64d-642d450f0e4d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.002233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1262ff1c107749f1969779d47c6241b6', 'request_id': 'req-f1502111-a619-454f-a64d-642d450f0e4d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.033363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] The token cache is being invalidate because project 1262ff1c107749f1969779d47c6241b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:46.034787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.035573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd299f2-10ea-48f5-9622-9db13120f1d7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:46.036563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.039234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1037/2075] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:45 2022] DELETE /identity/v3/projects/1262ff1c107749f1969779d47c6241b6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:46.044687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:46.048146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:46.120340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:46.121037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.121323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.121602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.123446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:46.146921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:46.147640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502111-a619-454f-a64d-642d450f0e4d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:46.153028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:46.153923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.154213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.154465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] PATH_INFO: `/v3/users/1e44974325d448ebb93c964d22e7530d` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.156159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e44974325d448ebb93c964d22e7530d)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:46.158325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:46.195170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:46.209600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:46.211998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:46.219331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e44974325d448ebb93c964d22e7530d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.223666 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1039/2076] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:46.227632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e44974325d448ebb93c964d22e7530d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.228357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e44974325d448ebb93c964d22e7530d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.229074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e44974325d448ebb93c964d22e7530d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.258669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e44974325d448ebb93c964d22e7530d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.274382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1038/2077] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:46 2022] DELETE /identity/v3/users/1e44974325d448ebb93c964d22e7530d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:46.594358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:46.596024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:46.625686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071c281-12d5-43ec-969a-002b5a12d9d8 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:46.636627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:46.638424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:46.693876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:46.694846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.695128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.695408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] PATH_INFO: `/v3/projects/50367127d6c84933bf47166908cdd691` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.696595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50367127d6c84933bf47166908cdd691)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:46.698602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:46.713913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637359d-32f5-465d-a7c6-573258ed5ce0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:46.718466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:46.719342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.719615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.719884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] PATH_INFO: `/v3/projects/77f51ea734544455a6d8aa988d6d6c22` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.721771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f51ea734544455a6d8aa988d6d6c22)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:46.723688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:46.748203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50367127d6c84933bf47166908cdd691', 'request_id': 'req-f16ee7a9-6f34-4681-92ac-5340e8397826'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.755048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50367127d6c84933bf47166908cdd691', 'request_id': 'req-f16ee7a9-6f34-4681-92ac-5340e8397826'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.760738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50367127d6c84933bf47166908cdd691', 'request_id': 'req-f16ee7a9-6f34-4681-92ac-5340e8397826'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.770688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f51ea734544455a6d8aa988d6d6c22', 'request_id': 'req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.774776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] The token cache is being invalidate because project 50367127d6c84933bf47166908cdd691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:46.775067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.775694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.776773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f51ea734544455a6d8aa988d6d6c22', 'request_id': 'req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.777301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1040/2078] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:46 2022] DELETE /identity/v3/projects/50367127d6c84933bf47166908cdd691 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:46.781231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:46.782636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:46.785480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f51ea734544455a6d8aa988d6d6c22', 'request_id': 'req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.806188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] The token cache is being invalidate because project 77f51ea734544455a6d8aa988d6d6c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:46.806499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.807124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-28eafd4f-c01a-4b4c-954b-3a9455bb04a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.809315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1039/2079] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:46 2022] DELETE /identity/v3/projects/77f51ea734544455a6d8aa988d6d6c22 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:46.813729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fcd11-a569-43cb-af9a-356766e88826 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.814011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fcd11-a569-43cb-af9a-356766e88826 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.814474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fcd11-a569-43cb-af9a-356766e88826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.833250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-371fcd11-a569-43cb-af9a-356766e88826 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:46.834467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-371fcd11-a569-43cb-af9a-356766e88826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:46.836291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:46.852973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ee7a9-6f34-4681-92ac-5340e8397826 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:46.864997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:46.896178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1040/2080] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:46.903961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e764356-6aa0-42c8-a337-6650e60da438 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.904252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e764356-6aa0-42c8-a337-6650e60da438 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.904528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e764356-6aa0-42c8-a337-6650e60da438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.914189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:46.915119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.915396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.915669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] PATH_INFO: `/v3/users/fbbd3fd90da242819e607f8c2587136c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.916901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbd3fd90da242819e607f8c2587136c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:46.918809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:46.922098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2e764356-6aa0-42c8-a337-6650e60da438 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:46.923312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2e764356-6aa0-42c8-a337-6650e60da438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:46.931665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1041/2081] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:46.935946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e764356-6aa0-42c8-a337-6650e60da438 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:46.944905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e764356-6aa0-42c8-a337-6650e60da438 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:46.949885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:46.950611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.950857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.951209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.951971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:46.952272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:46.953934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:46.966255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1042/2082] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:32:46.970723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:46.971925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbd3fd90da242819e607f8c2587136c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.978962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbd3fd90da242819e607f8c2587136c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.979659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbd3fd90da242819e607f8c2587136c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.980271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbd3fd90da242819e607f8c2587136c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:46.980458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb999d-1986-4ca7-92cd-ef19d35fba64 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:46.985021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:46.985655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:46.985965 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:46.986293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:46.986982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:46.988906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:46.993140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbd3fd90da242819e607f8c2587136c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:47.008099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1041/2083] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:46 2022] DELETE /identity/v3/users/fbbd3fd90da242819e607f8c2587136c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:47.019939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1043/2084] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:46 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:47.021223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.022968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:47.098070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576833-9c3b-43bd-a61b-ba673941bf7f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.116793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:47.159955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.160614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.160956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.161271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.161916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.163830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.185640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1042/2085] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:47 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:47.190032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.200578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec69de-e152-4521-9016-3490f0a4acb9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.205473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.206259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.206600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.206941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.207767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.209480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.219809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1044/2086] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:47.224025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.234681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930bd8a-81d0-463f-830d-27edcd690617 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.240012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.240694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.241141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.241427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.242183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.244047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.255531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1043/2087] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:47.260035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.270974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c44aa9-04af-4bd7-a266-256675ddf231 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.276127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d17b1-2c19-4cf0-b631-3b8b944fb576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.276997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d17b1-2c19-4cf0-b631-3b8b944fb576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.277287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d17b1-2c19-4cf0-b631-3b8b944fb576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.277592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d17b1-2c19-4cf0-b631-3b8b944fb576 admin admin] PATH_INFO: `/v3/projects/f2a662f6a5f9402b9f1cef45c9bf678f/users/3483f3d97f5b46a58f95a99276fbf798/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.294442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.296237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d17b1-2c19-4cf0-b631-3b8b944fb576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2a662f6a5f9402b9f1cef45c9bf678f, user_id=3483f3d97f5b46a58f95a99276fbf798, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.297364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:47.299469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d17b1-2c19-4cf0-b631-3b8b944fb576 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.318524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1045/2088] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:47 2022] PUT /identity/v3/projects/f2a662f6a5f9402b9f1cef45c9bf678f/users/3483f3d97f5b46a58f95a99276fbf798/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:47.320896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5bd97-95ae-44a1-a69b-a3f5cef0ae8c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.323400 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.323683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.323967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.340541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:47.341789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:47.382619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.383490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.383767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.384041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] PATH_INFO: `/v3/projects/84b84e9308b54add98998ec13c82ea16` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.385327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b84e9308b54add98998ec13c82ea16)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.387380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.400658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1046/2089] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:47.413801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.415418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:47.439873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b84e9308b54add98998ec13c82ea16', 'request_id': 'req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:47.447551 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b84e9308b54add98998ec13c82ea16', 'request_id': 'req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:47.454718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b84e9308b54add98998ec13c82ea16', 'request_id': 'req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:47.476397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] The token cache is being invalidate because project 84b84e9308b54add98998ec13c82ea16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:47.478268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:47.479932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-642e71c5-65c7-4cea-bc3a-28c5716ef1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:47.489048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1044/2090] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:47 2022] DELETE /identity/v3/projects/84b84e9308b54add98998ec13c82ea16 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:47.494021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a954b-43f0-487c-bf46-1f501af0ac95 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.494308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a954b-43f0-487c-bf46-1f501af0ac95 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.494584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a954b-43f0-487c-bf46-1f501af0ac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.504418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc47a5-4ae4-4e43-88f3-4898b4830127 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.513410 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b89a954b-43f0-487c-bf46-1f501af0ac95 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:47.514633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b89a954b-43f0-487c-bf46-1f501af0ac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:47.525781 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:47.544436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:47.576077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.576886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.577173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.577550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.581289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:47.612256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1045/2091] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:47.621109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e58fc-70d5-4f2c-a612-e088f0445458 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.621393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e58fc-70d5-4f2c-a612-e088f0445458 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.621941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e58fc-70d5-4f2c-a612-e088f0445458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.645589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ae3e58fc-70d5-4f2c-a612-e088f0445458 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:47.647019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ae3e58fc-70d5-4f2c-a612-e088f0445458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:47.660194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1046/2092] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:47.661383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e58fc-70d5-4f2c-a612-e088f0445458 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.661736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.663220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.673697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e58fc-70d5-4f2c-a612-e088f0445458 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.675839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1047/2093] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:47.679689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.680366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.680636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.680932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.681660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:47.681963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.683583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.700394 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1047/2094] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:47.701674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.711999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51921204-cbc1-4eb0-bc79-ac8c7287220b service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.719470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.720141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.720512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.720814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.721633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.723561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.751152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1048/2095] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:47 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:47.755578 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.765619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1667d99-ffd0-4504-b544-f54c9b22977a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.825554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.826337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.826683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.827047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.827714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.829698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.850828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1048/2096] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:47 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:47.855216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.867039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bcded-f879-42fa-85bc-c210608def41 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.873461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.874199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.874523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.874797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.875666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.878127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.890311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1049/2097] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:47.895345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.906255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d6e5-5951-46e4-9fea-80198cdfa4c4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.912561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741fec6-f7a9-4729-9fad-b5ae02e49d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.913366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741fec6-f7a9-4729-9fad-b5ae02e49d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.913667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741fec6-f7a9-4729-9fad-b5ae02e49d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.913942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741fec6-f7a9-4729-9fad-b5ae02e49d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.914794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741fec6-f7a9-4729-9fad-b5ae02e49d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.916820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741fec6-f7a9-4729-9fad-b5ae02e49d22 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.932360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1049/2098] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:47.934272 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:47.944874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9d35b-9ac7-44be-a9eb-1e12e9eaa5d2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:47.949508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:47.950932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.950932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.950932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] PATH_INFO: `/v3/projects/3d59561c31c74b7fb1909e17410bbf72/users/6b81170adb26410b840d0a4caef624af/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:47.966797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d59561c31c74b7fb1909e17410bbf72, user_id=6b81170adb26410b840d0a4caef624af, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:47.969846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:47.985458 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1050/2099] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:47 2022] PUT /identity/v3/projects/3d59561c31c74b7fb1909e17410bbf72/users/6b81170adb26410b840d0a4caef624af/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:47.998708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f36484-4d45-43d7-a440-d5b84e7a3516 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:47.999078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f36484-4d45-43d7-a440-d5b84e7a3516 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:47.999444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f36484-4d45-43d7-a440-d5b84e7a3516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.029024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-57f36484-4d45-43d7-a440-d5b84e7a3516 None None] MFA Rules not processed for user `6b81170adb26410b840d0a4caef624af`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:48.030240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-57f36484-4d45-43d7-a440-d5b84e7a3516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:48.100313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1050/2100] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:48.105002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:48.176592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c1320-31ed-4ba0-a3c9-ed4fefb91687 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:48.183085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:48.183770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.184055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.184328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.185088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:48.187030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:48.200579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:48.215435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1051/2101] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:48 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:48.219761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f36484-4d45-43d7-a440-d5b84e7a3516 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:48.231281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f36484-4d45-43d7-a440-d5b84e7a3516 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:48.250659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:48.292365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:48.293168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.293452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.293724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.294450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:48.296402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:48.321409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1051/2102] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:48 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:48.322593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:48.334134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c97b2-8251-48a7-b074-07766e6b0370 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:48.339446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:48.340225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.340554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.340866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.341596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:48.343231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:48.354866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1052/2103] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:48.358979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:48.369783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c2ddb-faad-4ba0-ba36-cc4e7f2f51a8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:48.375714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:48.378347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.378734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.379109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] PATH_INFO: `/v3/projects/284eeee344514e73a47047e7082d4195/users/a62110cef23744cca45b624af2bd2135/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.395584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=284eeee344514e73a47047e7082d4195, user_id=a62110cef23744cca45b624af2bd2135, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:48.398264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:48.413630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1052/2104] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:48 2022] PUT /identity/v3/projects/284eeee344514e73a47047e7082d4195/users/a62110cef23744cca45b624af2bd2135/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:48.417976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:48.431270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632bb3-9d3c-43f4-a701-7ec539f1cafb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:48.498296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb0145-2b78-43c5-bde1-57f774671f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:48.499563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0145-2b78-43c5-bde1-57f774671f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.499848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0145-2b78-43c5-bde1-57f774671f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.500179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0145-2b78-43c5-bde1-57f774671f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.501714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb0145-2b78-43c5-bde1-57f774671f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:48.503427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb0145-2b78-43c5-bde1-57f774671f92 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:48.517015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1053/2105] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:48.521930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:48.534382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167de98-5087-4526-b64e-163d0d19ef6b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:48.547748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:48.551975 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.552269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.552550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] PATH_INFO: `/v3/projects/284eeee344514e73a47047e7082d4195/users/a62110cef23744cca45b624af2bd2135/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.557950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284eeee344514e73a47047e7082d4195, user_id=a62110cef23744cca45b624af2bd2135, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:48.564053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:48.598569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1053/2106] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:48 2022] PUT /identity/v3/projects/284eeee344514e73a47047e7082d4195/users/a62110cef23744cca45b624af2bd2135/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:48.602228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9de0ba-6373-4bdf-9afe-8d79d09065f1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.602684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9de0ba-6373-4bdf-9afe-8d79d09065f1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.603106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9de0ba-6373-4bdf-9afe-8d79d09065f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.646743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0f9de0ba-6373-4bdf-9afe-8d79d09065f1 None None] MFA Rules not processed for user `a62110cef23744cca45b624af2bd2135`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:48.648152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0f9de0ba-6373-4bdf-9afe-8d79d09065f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:48.747248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1054/2107] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:48.758756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:48.760570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:48.834431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c699f-aadc-4b21-acd2-e7bfc90840e9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:48.839861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:48.840835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.841268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.842334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.855377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:48.857610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:48.868974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:48.868974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:48.868974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:48.881233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1054/2108] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:48.944582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] MFA Rules not processed for user `3483f3d97f5b46a58f95a99276fbf798`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:48.946193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:49.023016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:49.036680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd28a-bbe7-4137-95c9-55727616979b service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:49.047104 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:49.048933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:49.049400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:49.050228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:49.114428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:49.140344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1055/2109] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:49.141798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:49.145185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:49.193226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:49.195080 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:49.209424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1055/2110] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:49.250420 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77f416-9546-4872-8e78-3236f86f1fde None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:49.259431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:49.260253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:49.260535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:49.261395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:49.262324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:49.264706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:49.313197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1056/2111] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:49 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:49.314461 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:49.333652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab961ba-8a97-4115-abd8-6cc85e0fa006 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:49.345137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:49.419115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:49.420326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:49.420672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:49.421056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:49.422155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:49.424331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:49.456375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1056/2112] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:49 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:49.460332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:49.475819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e8711-face-460b-b18e-ac768b437284 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:49.482083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:49.482786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:49.483058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:49.483329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:49.484059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:49.485724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:49.498263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1057/2113] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:49.502816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:49.513112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba4e63-3f94-4dc1-8e29-a65da856c3ac admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:49.518485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:49.519396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:49.519710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:49.519988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] PATH_INFO: `/v3/projects/85c83d0d6a3143a29a274bf98ee50155/users/8d318a43af44428aaf53cd5d4a920fdf/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:49.537651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c83d0d6a3143a29a274bf98ee50155, user_id=8d318a43af44428aaf53cd5d4a920fdf, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:49.540566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:49.571667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1057/2114] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:49 2022] PUT /identity/v3/projects/85c83d0d6a3143a29a274bf98ee50155/users/8d318a43af44428aaf53cd5d4a920fdf/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:49.577290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:49.598453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094698-ce59-4d42-88bf-caaf9243fdea admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:49.666980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:49.667923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:49.668381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:49.668850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:49.669877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:49.671662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:49.683183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1058/2115] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:49.687340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:49.699521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fd67-873c-4aac-a9f0-c6693f5c874a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:49.704897 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599f5ae-9651-4788-8320-10bd123b5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:49.705953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f5ae-9651-4788-8320-10bd123b5593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:49.706222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f5ae-9651-4788-8320-10bd123b5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:49.706491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599f5ae-9651-4788-8320-10bd123b5593 admin admin] PATH_INFO: `/v3/projects/85c83d0d6a3143a29a274bf98ee50155/users/8d318a43af44428aaf53cd5d4a920fdf/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:49.708447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599f5ae-9651-4788-8320-10bd123b5593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c83d0d6a3143a29a274bf98ee50155, user_id=8d318a43af44428aaf53cd5d4a920fdf, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:49.711125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599f5ae-9651-4788-8320-10bd123b5593 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:49.722013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1058/2116] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:49 2022] PUT /identity/v3/projects/85c83d0d6a3143a29a274bf98ee50155/users/8d318a43af44428aaf53cd5d4a920fdf/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:50.144115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:50.146793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:50.174893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d3936-b0a4-4664-bc18-c89d0c46a87c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:50.294839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:50.296258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:50.296547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:50.296853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] PATH_INFO: `/v3/users/74e909686fce45cfa7f45b5bac7908d1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:50.300158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e909686fce45cfa7f45b5bac7908d1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:50.302564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:50.312404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:50.396959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e909686fce45cfa7f45b5bac7908d1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:50.410714 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e909686fce45cfa7f45b5bac7908d1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:50.412265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e909686fce45cfa7f45b5bac7908d1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:50.413022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e909686fce45cfa7f45b5bac7908d1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:50.427865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a515c066-0202-4cf4-81b9-ba2934959218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e909686fce45cfa7f45b5bac7908d1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:50.452860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1059/2117] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:50 2022] DELETE /identity/v3/users/74e909686fce45cfa7f45b5bac7908d1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:50.458238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:50.458867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:50.458867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:50.487812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:50.492248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:50.560887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efadc0-024b-481b-b8cb-bab2375bd2ee None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:50.561884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efadc0-024b-481b-b8cb-bab2375bd2ee None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:50.562180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efadc0-024b-481b-b8cb-bab2375bd2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:50.571256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1059/2118] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:50.598963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-67efadc0-024b-481b-b8cb-bab2375bd2ee None None] MFA Rules not processed for user `8d318a43af44428aaf53cd5d4a920fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:50.600221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-67efadc0-024b-481b-b8cb-bab2375bd2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:50.607440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:50.608786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:50.711162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d7f3-66cf-4e15-adb6-0eee051106e4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:50.721339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1060/2119] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:50.732011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:50.732924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:50.733271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:50.733393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:50.733628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:50.733771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:50.734123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:50.755923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:50.760252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:50.785099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] MFA Rules not processed for user `3483f3d97f5b46a58f95a99276fbf798`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:50.786604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:50.792237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1060/2120] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:50.883766 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1061/2121] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:50.897729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:50.900075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:50.938193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:51.079499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e503fd-2aad-42f2-8343-9ea02f14baa3 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.085428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c77dd-4fc6-491c-8022-81688859ab01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.086089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c77dd-4fc6-491c-8022-81688859ab01 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.086387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c77dd-4fc6-491c-8022-81688859ab01 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.086639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c77dd-4fc6-491c-8022-81688859ab01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.088506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6b0c77dd-4fc6-491c-8022-81688859ab01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:51.100433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c77dd-4fc6-491c-8022-81688859ab01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:51.102089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c77dd-4fc6-491c-8022-81688859ab01 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:51.113504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1061/2122] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:51.218106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:51.219555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:51.254665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9e245-4518-4b85-86c5-9e6acdc0eca4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.273844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.274759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.275043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.275316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] PATH_INFO: `/v3/projects/7281c1dbbe794465ae74221ed36d45a7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.277809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7281c1dbbe794465ae74221ed36d45a7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:51.281465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:51.292443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:51.351645 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7281c1dbbe794465ae74221ed36d45a7', 'request_id': 'req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:51.358234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7281c1dbbe794465ae74221ed36d45a7', 'request_id': 'req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:51.369431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7281c1dbbe794465ae74221ed36d45a7', 'request_id': 'req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:51.388827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] The token cache is being invalidate because project 7281c1dbbe794465ae74221ed36d45a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:51.390125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:51.390340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c186aeb-0a08-4fd1-90b4-29837aa4efa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:51.397049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1062/2123] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:51 2022] DELETE /identity/v3/projects/7281c1dbbe794465ae74221ed36d45a7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:51.398451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609628-7e1a-4ac0-a01b-1aeb564fe554 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.398737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609628-7e1a-4ac0-a01b-1aeb564fe554 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.399012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609628-7e1a-4ac0-a01b-1aeb564fe554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.428120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a5609628-7e1a-4ac0-a01b-1aeb564fe554 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:51.429963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a5609628-7e1a-4ac0-a01b-1aeb564fe554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:51.553238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1062/2124] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:51.562364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1b3c-1c02-439c-bc95-48841029fca7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.562694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1b3c-1c02-439c-bc95-48841029fca7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.562926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e1b3c-1c02-439c-bc95-48841029fca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.588760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4e9e1b3c-1c02-439c-bc95-48841029fca7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:51.589996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4e9e1b3c-1c02-439c-bc95-48841029fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:51.598952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1063/2125] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:51.603291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609628-7e1a-4ac0-a01b-1aeb564fe554 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:51.615287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609628-7e1a-4ac0-a01b-1aeb564fe554 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.620854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.623599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.623839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.624115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.624899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:51.625331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:51.627255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:51.642998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1063/2126] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:51.647395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e1b3c-1c02-439c-bc95-48841029fca7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:51.659767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e1b3c-1c02-439c-bc95-48841029fca7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.672288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.673014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.673293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.673657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.674361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:51.677197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:51.722181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1064/2127] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:51 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:51.723285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:51.735160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d05d-9324-4176-a79e-4413d7a0e916 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.838938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.839627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.839912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.840188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.840967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:51.842967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:51.872502 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1064/2128] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:51 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:51.876674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:51.889656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ccd31-679c-4a50-b0e3-0afae6b7df76 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.901249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.901971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.902254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.902528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.903347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:51.905055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:51.916022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1065/2129] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:51.920067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:51.931160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f232b6-0051-47fd-a98a-89f3dd5919ec admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.936921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89b73-bdc8-4f9b-a9b5-3a9972d58f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.937672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89b73-bdc8-4f9b-a9b5-3a9972d58f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.938024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89b73-bdc8-4f9b-a9b5-3a9972d58f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.938364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89b73-bdc8-4f9b-a9b5-3a9972d58f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.939250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac89b73-bdc8-4f9b-a9b5-3a9972d58f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:51.941111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac89b73-bdc8-4f9b-a9b5-3a9972d58f34 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:51.948093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:51.961709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1065/2130] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:51.962993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:51.973626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbaf815-6d87-471f-bbb8-927fb4d677c7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:51.978579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:51.979479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:51.979755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:51.980065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] PATH_INFO: `/v3/projects/a1e946f8e5c34801a3932718fcd09162/users/fe56be7b494d4e3d87a7be8b444b1493/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:51.995253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e946f8e5c34801a3932718fcd09162, user_id=fe56be7b494d4e3d87a7be8b444b1493, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:52.003124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:52.020036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1066/2131] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:51 2022] PUT /identity/v3/projects/a1e946f8e5c34801a3932718fcd09162/users/fe56be7b494d4e3d87a7be8b444b1493/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:52.030207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228b54c-924e-40b9-bba9-2afe2b74f527 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:52.030605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228b54c-924e-40b9-bba9-2afe2b74f527 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:52.030887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228b54c-924e-40b9-bba9-2afe2b74f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:52.060463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7228b54c-924e-40b9-bba9-2afe2b74f527 None None] MFA Rules not processed for user `fe56be7b494d4e3d87a7be8b444b1493`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:52.061717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7228b54c-924e-40b9-bba9-2afe2b74f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:52.174998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1066/2132] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:52.187295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:52.198249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:52.288656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c067ac0-6485-41b4-8550-3ebd29912b3b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:52.309474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaefea-f8a7-40a3-af32-e919b440ee31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:52.310260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaefea-f8a7-40a3-af32-e919b440ee31 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:52.310434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaefea-f8a7-40a3-af32-e919b440ee31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:52.310904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaefea-f8a7-40a3-af32-e919b440ee31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:52.322596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaefea-f8a7-40a3-af32-e919b440ee31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:52.324155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaefea-f8a7-40a3-af32-e919b440ee31 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:52.341137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1067/2133] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:52.373206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139585-c961-49e8-aa2e-df48203c0624 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:52.373494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139585-c961-49e8-aa2e-df48203c0624 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:52.373775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31139585-c961-49e8-aa2e-df48203c0624 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:52.375167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1067/2134] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:32:52.386411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:52.386885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:52.387167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:52.419370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:52.420666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:52.462197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139585-c961-49e8-aa2e-df48203c0624 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:52.464815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31139585-c961-49e8-aa2e-df48203c0624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:52.495575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:52.555120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31139585-c961-49e8-aa2e-df48203c0624 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:52.561261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:52.562621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:52.562777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1068/2135] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:32:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:52.563209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:52.563703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] PATH_INFO: `/v3/users/1903cd549e764595b2a1be04487f96eb` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:52.565391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1903cd549e764595b2a1be04487f96eb)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:52.567621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:52.579333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:52.581251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:52.600282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba2c29-c809-473d-bd65-7bf7b2b6208f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:52.606214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:52.606886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:52.607169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:52.607445 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:52.618666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:52.620863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:52.634461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1069/2136] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:52.671999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1903cd549e764595b2a1be04487f96eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:52.680550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1903cd549e764595b2a1be04487f96eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:52.681302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1903cd549e764595b2a1be04487f96eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:52.681946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1903cd549e764595b2a1be04487f96eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:52.695040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b496e12a-4d1e-44b5-8e44-e9f8d891a75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1903cd549e764595b2a1be04487f96eb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:52.713957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1068/2137] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:52 2022] DELETE /identity/v3/users/1903cd549e764595b2a1be04487f96eb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:52.944568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:52.960015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c46f7-ba92-4def-8a24-4e4dcd1d90c2 service placement] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.030817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.031723 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.031992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.032283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] PATH_INFO: `/v3/projects/2e782c02413f471e945bb61e003e685d` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.033665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e782c02413f471e945bb61e003e685d)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.035580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.082421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e782c02413f471e945bb61e003e685d', 'request_id': 'req-9e087d47-1b9e-41b1-987b-444c01a169ad'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.088433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e782c02413f471e945bb61e003e685d', 'request_id': 'req-9e087d47-1b9e-41b1-987b-444c01a169ad'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.096921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e782c02413f471e945bb61e003e685d', 'request_id': 'req-9e087d47-1b9e-41b1-987b-444c01a169ad'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.107606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] The token cache is being invalidate because project 2e782c02413f471e945bb61e003e685d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:53.107897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.108562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9e087d47-1b9e-41b1-987b-444c01a169ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.110347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1070/2138] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:52 2022] DELETE /identity/v3/projects/2e782c02413f471e945bb61e003e685d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:53.116061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb0185-4d67-40ee-8d3f-a9ca99fef447 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.116352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb0185-4d67-40ee-8d3f-a9ca99fef447 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.116652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb0185-4d67-40ee-8d3f-a9ca99fef447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.135507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-82fb0185-4d67-40ee-8d3f-a9ca99fef447 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:53.136872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-82fb0185-4d67-40ee-8d3f-a9ca99fef447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:53.141401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:53.219370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1069/2139] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:53.227774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56e01b-2ecf-441b-86a8-1d2c23fa721a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.228062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56e01b-2ecf-441b-86a8-1d2c23fa721a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.228337 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56e01b-2ecf-441b-86a8-1d2c23fa721a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.248699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ac56e01b-2ecf-441b-86a8-1d2c23fa721a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:53.249945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ac56e01b-2ecf-441b-86a8-1d2c23fa721a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:53.258208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1071/2140] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:53.262648 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb0185-4d67-40ee-8d3f-a9ca99fef447 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.273217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb0185-4d67-40ee-8d3f-a9ca99fef447 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.278912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.279576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.279853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.280127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.280896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:53.281203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.282900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.296498 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1070/2141] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:53.301345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56e01b-2ecf-441b-86a8-1d2c23fa721a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.311365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56e01b-2ecf-441b-86a8-1d2c23fa721a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.317861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.318940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.318940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.319156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.319733 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.321702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.358911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1072/2142] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:53 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:53.363222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.373718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e027-42e9-41c0-a470-fb4f33f077dc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.444322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.445173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.445531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.445889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.446597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.448532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.474622 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1071/2143] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:53 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:53.478529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.495000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0170b-3b3d-46d4-8570-bcee741fde0f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.505721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.506421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.506690 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.506981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.507722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.509828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.523887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1073/2144] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:53.527969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.542997 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e095ee0-a55d-4a2d-9f2e-7315308917a0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.556560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.557281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.557627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.557833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.558571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.560177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.582198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1072/2145] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:32:53.586948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.601914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac768e-9626-43a5-a720-3332ca386c69 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.607106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f3817-bf63-4a9f-aeec-0648530467e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.608038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3817-bf63-4a9f-aeec-0648530467e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.608269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3817-bf63-4a9f-aeec-0648530467e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.608555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f3817-bf63-4a9f-aeec-0648530467e5 admin admin] PATH_INFO: `/v3/projects/f8e46ecbe73547b4a2d388812d853fb8/users/8892ac71fd704ed5866d8b6e70fa468d/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.613112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:53.630347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f3817-bf63-4a9f-aeec-0648530467e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e46ecbe73547b4a2d388812d853fb8, user_id=8892ac71fd704ed5866d8b6e70fa468d, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.633868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f3817-bf63-4a9f-aeec-0648530467e5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.650711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1074/2146] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:53 2022] PUT /identity/v3/projects/f8e46ecbe73547b4a2d388812d853fb8/users/8892ac71fd704ed5866d8b6e70fa468d/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:53.652778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.660658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:53.661308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.661691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.662184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.675283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53243e40-6096-4f72-a587-425e5afac646 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.693024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] MFA Rules not processed for user `8892ac71fd704ed5866d8b6e70fa468d`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:53.694560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:53.742025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.742939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.743215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.743483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] PATH_INFO: `/v3/users/6b81170adb26410b840d0a4caef624af` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.744680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b81170adb26410b840d0a4caef624af)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:53.747108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:53.764847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:53.789831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1075/2147] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:32:53.797122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:53.798684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:53.803279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b81170adb26410b840d0a4caef624af'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.811464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b81170adb26410b840d0a4caef624af'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.812276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b81170adb26410b840d0a4caef624af'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.813036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b81170adb26410b840d0a4caef624af'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.846233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36ad66ff-1b59-437a-860a-74122a3b15f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b81170adb26410b840d0a4caef624af'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:53.867130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1073/2148] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:53 2022] DELETE /identity/v3/users/6b81170adb26410b840d0a4caef624af => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:53.870199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ae3b-f771-48b0-9543-e3bd31e68fc5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:53.871873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.872159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.872796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.894816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:53.896224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:53.943578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:53.944588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:53.944588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:53.944838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:53.947284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:54.005896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:54.013939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1074/2149] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:54.023333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:54.025579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:54.032892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:54.035097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:54.064452 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1076/2150] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:54.132278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5600d-6314-451c-b3b3-c0f156618596 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:54.144354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:54.146684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:54.147644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:54.148785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:54.170286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:54.173492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:54.189861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1075/2151] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:32:54.734643 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:54.736463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:54.756694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f017b-3ee5-488c-ae99-f046a5cf4b3c service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:54.762905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:54.763894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:54.764210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:54.764484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] PATH_INFO: `/v3/projects/3d59561c31c74b7fb1909e17410bbf72` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:54.766371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d59561c31c74b7fb1909e17410bbf72)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:54.768525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:54.822810 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d59561c31c74b7fb1909e17410bbf72', 'request_id': 'req-33b85162-f500-4655-83b9-538b84e2447f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:54.829842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d59561c31c74b7fb1909e17410bbf72', 'request_id': 'req-33b85162-f500-4655-83b9-538b84e2447f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:54.839592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d59561c31c74b7fb1909e17410bbf72', 'request_id': 'req-33b85162-f500-4655-83b9-538b84e2447f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:54.851457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] The token cache is being invalidate because project 3d59561c31c74b7fb1909e17410bbf72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:54.851747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:54.852406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:54.854053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1077/2152] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:54 2022] DELETE /identity/v3/projects/3d59561c31c74b7fb1909e17410bbf72 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:54.858152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:54.868550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc713d4-ff9b-41cf-b500-aae1876ebc0a service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:54.909363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:54.938756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:54.939682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:54.939998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:54.940276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] PATH_INFO: `/v3/users/a62110cef23744cca45b624af2bd2135` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:54.941515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62110cef23744cca45b624af2bd2135)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:54.943976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:54.993409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62110cef23744cca45b624af2bd2135'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:55.000605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62110cef23744cca45b624af2bd2135'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:55.002010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62110cef23744cca45b624af2bd2135'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:55.002010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62110cef23744cca45b624af2bd2135'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:55.014720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-524b14aa-81fe-4faf-a279-c74f2fd5a96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62110cef23744cca45b624af2bd2135'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:55.029525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1076/2153] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:32:54 2022] DELETE /identity/v3/users/a62110cef23744cca45b624af2bd2135 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:55.799165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:55.801921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:55.829793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b85162-f500-4655-83b9-538b84e2447f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:55.929579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:55.942460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:55.942950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:55.943251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] PATH_INFO: `/v3/projects/284eeee344514e73a47047e7082d4195` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:55.946244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=284eeee344514e73a47047e7082d4195)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:55.948323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.015710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284eeee344514e73a47047e7082d4195', 'request_id': 'req-a0fd38d7-3750-485c-b05e-f2f657f1d208'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:56.022057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284eeee344514e73a47047e7082d4195', 'request_id': 'req-a0fd38d7-3750-485c-b05e-f2f657f1d208'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:56.031712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284eeee344514e73a47047e7082d4195', 'request_id': 'req-a0fd38d7-3750-485c-b05e-f2f657f1d208'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:56.040437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:56.048154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] The token cache is being invalidate because project 284eeee344514e73a47047e7082d4195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:32:56.048736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:56.049796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a0fd38d7-3750-485c-b05e-f2f657f1d208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:32:56.052767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1078/2154] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:32:55 2022] DELETE /identity/v3/projects/284eeee344514e73a47047e7082d4195 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:56.057745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed2f70-0520-43cf-a179-55065d61917b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.058246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed2f70-0520-43cf-a179-55065d61917b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.058341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed2f70-0520-43cf-a179-55065d61917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.077687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-42ed2f70-0520-43cf-a179-55065d61917b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:56.078906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-42ed2f70-0520-43cf-a179-55065d61917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:56.151626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1077/2155] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:56.161245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6db29-ff95-4743-a67f-2c7ed08e6ef6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.161529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6db29-ff95-4743-a67f-2c7ed08e6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.161801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6db29-ff95-4743-a67f-2c7ed08e6ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.180883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a4f6db29-ff95-4743-a67f-2c7ed08e6ef6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:56.182114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a4f6db29-ff95-4743-a67f-2c7ed08e6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:56.190940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1079/2156] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:56.195672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed2f70-0520-43cf-a179-55065d61917b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.210683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed2f70-0520-43cf-a179-55065d61917b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.219227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.220426 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.220739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.221097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.221830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:32:56.222139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.223740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.236169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1078/2157] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:32:56.241347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6db29-ff95-4743-a67f-2c7ed08e6ef6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.252315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6db29-ff95-4743-a67f-2c7ed08e6ef6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.257851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.258558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.258840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.259116 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.259852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.261831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.287526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1080/2158] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:56 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:56.291718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.302413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24fac2-b505-4d79-9508-16ec8850e87b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.348734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:56.366898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.367870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.368348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.368756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.369802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.371773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.396041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1079/2159] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:56 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:32:56.400201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.412856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766ec73-8c05-4ff1-a7cf-3beb5147e8f9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.424506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.425296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.425651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.426972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.427788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.429514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.443757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1081/2160] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:56.445046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.458158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5f0ba-113a-43e9-b855-aa11fa328665 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.463286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63c0d3-9315-4c1b-a2cb-696888596614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.464091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c0d3-9315-4c1b-a2cb-696888596614 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.464316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c0d3-9315-4c1b-a2cb-696888596614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.464614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63c0d3-9315-4c1b-a2cb-696888596614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.465559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63c0d3-9315-4c1b-a2cb-696888596614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.467173 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63c0d3-9315-4c1b-a2cb-696888596614 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.482750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1080/2161] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:56.483619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.498649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd44960-2e94-4b68-a70c-a05665ad6b86 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.505660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.506744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.507032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.507315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] PATH_INFO: `/v3/projects/93eb233b385644b9bf2463adf72c779c/users/b0d7326b83144a6fac94e08ab9b578f6/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.527401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93eb233b385644b9bf2463adf72c779c, user_id=b0d7326b83144a6fac94e08ab9b578f6, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.530208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.546142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1082/2162] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:56 2022] PUT /identity/v3/projects/93eb233b385644b9bf2463adf72c779c/users/b0d7326b83144a6fac94e08ab9b578f6/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:32:56.557730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9be0-9f7f-40b1-b004-0eb01d06ed96 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.558017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9be0-9f7f-40b1-b004-0eb01d06ed96 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.558294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9be0-9f7f-40b1-b004-0eb01d06ed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.586352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-377b9be0-9f7f-40b1-b004-0eb01d06ed96 None None] MFA Rules not processed for user `b0d7326b83144a6fac94e08ab9b578f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:56.587822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-377b9be0-9f7f-40b1-b004-0eb01d06ed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:56.653072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1081/2163] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:56.657740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.722517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804871f2-40fd-4436-bd70-b3aee9441a00 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.728133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.728837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.729116 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.729389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.730082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.732051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.760700 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1083/2164] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:32:56 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:56.764978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9be0-9f7f-40b1-b004-0eb01d06ed96 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.777179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9be0-9f7f-40b1-b004-0eb01d06ed96 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.841955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.842837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.843043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.843327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.844137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.847819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.869023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1082/2165] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:32:56 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:32:56.873676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.885605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176925-66b0-4605-9d8e-68651a3b399c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.890558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.891243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.891524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.891799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.892596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.894268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.905562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1084/2166] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:56.910019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.920630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa4f4-2843-406b-96c1-f6a0c84e79cc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:56.925532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:56.926891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:56.927168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:56.927447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] PATH_INFO: `/v3/projects/d85e9ceae3f04638a9695f2f67c55b4b/users/bb7820ffdd7947f88bfa9a669879e788/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:56.943651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85e9ceae3f04638a9695f2f67c55b4b, user_id=bb7820ffdd7947f88bfa9a669879e788, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:56.948404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:56.974538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1083/2167] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:56 2022] PUT /identity/v3/projects/d85e9ceae3f04638a9695f2f67c55b4b/users/bb7820ffdd7947f88bfa9a669879e788/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:56.978740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:56.989354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1e6f5-ec51-4c38-a29f-e058eaba65a9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:57.072751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c99065-3ecd-4c26-8711-bf2165403ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:57.073582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c99065-3ecd-4c26-8711-bf2165403ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:57.073992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c99065-3ecd-4c26-8711-bf2165403ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:57.074360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c99065-3ecd-4c26-8711-bf2165403ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:57.075357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c99065-3ecd-4c26-8711-bf2165403ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:57.077198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c99065-3ecd-4c26-8711-bf2165403ebd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:57.088973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1085/2168] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:32:57.093088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:57.106197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b218b83-dc5b-4553-af6e-86ad2b88f7b2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:57.110908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:57.112030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:57.112416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:57.112689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] PATH_INFO: `/v3/projects/d85e9ceae3f04638a9695f2f67c55b4b/users/bb7820ffdd7947f88bfa9a669879e788/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:57.115294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85e9ceae3f04638a9695f2f67c55b4b, user_id=bb7820ffdd7947f88bfa9a669879e788, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:57.117543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:57.129934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1084/2169] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:32:57 2022] PUT /identity/v3/projects/d85e9ceae3f04638a9695f2f67c55b4b/users/bb7820ffdd7947f88bfa9a669879e788/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:32:57.140910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:57.141730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:57.141730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:57.152123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:57.183501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] MFA Rules not processed for user `bb7820ffdd7947f88bfa9a669879e788`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:32:57.184837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:57.272235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1086/2170] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:32:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:32:57.281854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:57.284649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:57.293804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:32:57.359004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba84881-1b20-420d-b96d-97a5762e89f2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:57.363390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:57.364166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:57.364510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:57.365222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:57.377128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:57.378882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:57.391869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1085/2171] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:32:57.494620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:32:57.496546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:32:57.511288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0d5da-b7ad-4001-b792-15669ed65ed1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:32:57.515526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51748d1d-715d-41b6-919d-b4f67e3ae39a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:32:57.516213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51748d1d-715d-41b6-919d-b4f67e3ae39a service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:32:57.516499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51748d1d-715d-41b6-919d-b4f67e3ae39a service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:32:57.516865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51748d1d-715d-41b6-919d-b4f67e3ae39a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:32:57.580475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51748d1d-715d-41b6-919d-b4f67e3ae39a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:32:57.582176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51748d1d-715d-41b6-919d-b4f67e3ae39a service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:32:57.595027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1087/2172] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:32:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:01.543178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:01.609374 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e53cd-76e7-4041-9be3-d5b46280abc4 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:01.615026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:01.615821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:01.616100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:01.616338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] PATH_INFO: `/v3/users/b0d7326b83144a6fac94e08ab9b578f6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:01.617611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d7326b83144a6fac94e08ab9b578f6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:01.619518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:01.681919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d7326b83144a6fac94e08ab9b578f6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:01.689389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d7326b83144a6fac94e08ab9b578f6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:01.690149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d7326b83144a6fac94e08ab9b578f6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:01.690781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d7326b83144a6fac94e08ab9b578f6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:01.703874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d7326b83144a6fac94e08ab9b578f6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:01.720557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1086/2173] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:01 2022] DELETE /identity/v3/users/b0d7326b83144a6fac94e08ab9b578f6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:01.725143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:01.725605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:01.725712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:01.743016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:01.744206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:01.817440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1088/2174] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:01.827437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:01.829519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:01.862989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:01.909731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e11a0-0cbc-43ef-8a00-250648bd476c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:01.913886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:01.914605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:01.914885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:01.915186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:01.925353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:01.927307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:01.938261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1087/2175] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:02.372304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:02.374748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:02.389410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d7868-807f-4542-9178-aeb752a978bb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:02.394677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:02.395757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:02.396138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:02.396544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] PATH_INFO: `/v3/projects/93eb233b385644b9bf2463adf72c779c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:02.397972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=93eb233b385644b9bf2463adf72c779c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:02.400021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:02.430006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:02.459683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93eb233b385644b9bf2463adf72c779c', 'request_id': 'req-eefb1362-578d-494d-8c48-273247f136fc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.466485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93eb233b385644b9bf2463adf72c779c', 'request_id': 'req-eefb1362-578d-494d-8c48-273247f136fc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.474661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93eb233b385644b9bf2463adf72c779c', 'request_id': 'req-eefb1362-578d-494d-8c48-273247f136fc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.485751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] The token cache is being invalidate because project 93eb233b385644b9bf2463adf72c779c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:02.486007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.486637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.488315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1089/2176] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:02 2022] DELETE /identity/v3/projects/93eb233b385644b9bf2463adf72c779c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:02.494217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:02.503968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c908cb-938e-4d54-bb13-9e0963d2d0ae service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:02.565253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:02.566222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:02.566607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:02.566942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] PATH_INFO: `/v3/users/bb7820ffdd7947f88bfa9a669879e788` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:02.568284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7820ffdd7947f88bfa9a669879e788)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:02.570499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:02.620495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7820ffdd7947f88bfa9a669879e788'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.627372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7820ffdd7947f88bfa9a669879e788'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.628032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7820ffdd7947f88bfa9a669879e788'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.628633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7820ffdd7947f88bfa9a669879e788'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.641540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7820ffdd7947f88bfa9a669879e788'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:02.658105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1088/2177] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:02 2022] DELETE /identity/v3/users/bb7820ffdd7947f88bfa9a669879e788 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:02.982698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:02.984244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.001052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb1362-578d-494d-8c48-273247f136fc admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.065067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.066024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.066296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.066621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] PATH_INFO: `/v3/projects/d85e9ceae3f04638a9695f2f67c55b4b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.068403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85e9ceae3f04638a9695f2f67c55b4b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.070431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.118911 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85e9ceae3f04638a9695f2f67c55b4b', 'request_id': 'req-bdd5ad29-9344-40d8-97ce-3476b440fa68'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.125302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85e9ceae3f04638a9695f2f67c55b4b', 'request_id': 'req-bdd5ad29-9344-40d8-97ce-3476b440fa68'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.136227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85e9ceae3f04638a9695f2f67c55b4b', 'request_id': 'req-bdd5ad29-9344-40d8-97ce-3476b440fa68'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.141823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.143404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.159574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] The token cache is being invalidate because project d85e9ceae3f04638a9695f2f67c55b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:03.159949 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989a42-60e7-4c92-93a8-d82f3a0c054e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.160064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.161392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdd5ad29-9344-40d8-97ce-3476b440fa68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.163253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1090/2178] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:02 2022] DELETE /identity/v3/projects/d85e9ceae3f04638a9695f2f67c55b4b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:03.169267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2818-2b77-44f5-ad87-44cdb264981d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.169561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2818-2b77-44f5-ad87-44cdb264981d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.169825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f2818-2b77-44f5-ad87-44cdb264981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.190250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d87f2818-2b77-44f5-ad87-44cdb264981d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:03.191484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d87f2818-2b77-44f5-ad87-44cdb264981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.224528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:03.243208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.244163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.244486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.244703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] PATH_INFO: `/v3/users/8892ac71fd704ed5866d8b6e70fa468d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.246101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8892ac71fd704ed5866d8b6e70fa468d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.248142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.262022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:03.292109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1091/2179] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:03.301275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aa7f6-95a4-49ba-8a95-0d12570610ce None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.301752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aa7f6-95a4-49ba-8a95-0d12570610ce None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.302071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aa7f6-95a4-49ba-8a95-0d12570610ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.322626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8892ac71fd704ed5866d8b6e70fa468d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.324073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-760aa7f6-95a4-49ba-8a95-0d12570610ce None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:03.325486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-760aa7f6-95a4-49ba-8a95-0d12570610ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.330518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8892ac71fd704ed5866d8b6e70fa468d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.331190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8892ac71fd704ed5866d8b6e70fa468d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.331788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8892ac71fd704ed5866d8b6e70fa468d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.335430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1092/2180] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:03.339538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aa7f6-95a4-49ba-8a95-0d12570610ce None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.347281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-84f6762e-1dd1-442a-abbc-a774dc3d01a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8892ac71fd704ed5866d8b6e70fa468d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.350602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aa7f6-95a4-49ba-8a95-0d12570610ce None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.356638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.357538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.357825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.358159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.358916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:03.359205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.360853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.364149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1089/2181] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:03 2022] DELETE /identity/v3/users/8892ac71fd704ed5866d8b6e70fa468d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:03.368473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.368803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.369086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.374357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1093/2182] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:33:03.378622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.380472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.387634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:03.388916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.393761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6167d6-f2a4-44a5-a837-ec34865de46f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.452739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.453771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.453925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1090/2183] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:03.454177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.454457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.455314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.457477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.464823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.466341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.486247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1094/2184] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:03.490397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.528736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647253-355f-40bb-990f-0af3a339da31 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.550916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:03.552419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786f1a6-86de-43f1-a906-48015d5623bd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.558141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.558835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.559164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.559482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.560285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.562454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.587124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1095/2185] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:03.587319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.587319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.587319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.587319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.588321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.596358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.597805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378312e7-3401-43da-b95a-a0d9b0604f7a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.598087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.602833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.603523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.603801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.604079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.604801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.606408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.608037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1091/2186] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:03.617980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1096/2187] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:33:03.621936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.632234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da725-5719-4b98-adc1-248e9db72541 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.637067 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d37bda-0c61-479b-b082-b131906182c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.637743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d37bda-0c61-479b-b082-b131906182c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.638022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d37bda-0c61-479b-b082-b131906182c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.638296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d37bda-0c61-479b-b082-b131906182c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.639016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d37bda-0c61-479b-b082-b131906182c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.640623 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d37bda-0c61-479b-b082-b131906182c8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.652688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1092/2188] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:33:03.656812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.667404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc09281-d1f2-4761-89f4-61e1fade68eb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.672869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.673857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.674197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.674535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] PATH_INFO: `/v3/projects/ac89e65e69664ca4b08a21dae10ed0de/users/a63046661e5f4ed2be56649bd70df628/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.691264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac89e65e69664ca4b08a21dae10ed0de, user_id=a63046661e5f4ed2be56649bd70df628, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.694178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.707706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1097/2189] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:03 2022] PUT /identity/v3/projects/ac89e65e69664ca4b08a21dae10ed0de/users/a63046661e5f4ed2be56649bd70df628/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:03.718640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.718937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.719220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.747646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] MFA Rules not processed for user `a63046661e5f4ed2be56649bd70df628`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:03.749236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.823704 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1093/2190] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:03.828206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.833341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:03.896169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.898361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:03.901903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a10093-c445-49ab-9d50-a938bfdddcb3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.908019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.909496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.909945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.910235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.911324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.913816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.921439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a125e-eed8-4062-8c2a-924c539a5333 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:03.929186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:03.930088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:03.930371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:03.930650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] PATH_INFO: `/v3/projects/f8e46ecbe73547b4a2d388812d853fb8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:03.931905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e46ecbe73547b4a2d388812d853fb8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:03.933984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:03.950441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1098/2191] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:03.951601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:03.992163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e46ecbe73547b4a2d388812d853fb8', 'request_id': 'req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:03.998846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e46ecbe73547b4a2d388812d853fb8', 'request_id': 'req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.004942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e46ecbe73547b4a2d388812d853fb8', 'request_id': 'req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.020146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] The token cache is being invalidate because project f8e46ecbe73547b4a2d388812d853fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:04.020524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.021198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7b11ed2-bd4c-44de-acab-cd982cf5f16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.023054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1094/2192] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:03 2022] DELETE /identity/v3/projects/f8e46ecbe73547b4a2d388812d853fb8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:04.027706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cddf-a82b-4ad2-af4c-a18c703669ae None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.027999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cddf-a82b-4ad2-af4c-a18c703669ae None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.028281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cddf-a82b-4ad2-af4c-a18c703669ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.029869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ab785-ccfa-4d01-85b8-de446f2e3dfb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.054494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7589cddf-a82b-4ad2-af4c-a18c703669ae None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:04.056377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7589cddf-a82b-4ad2-af4c-a18c703669ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.084066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:04.097095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.106389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.106389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.106389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.106389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.106389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.122827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1099/2193] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:03 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:04.126787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.128406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.129512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1095/2194] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:04.138192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd1be4-d479-444c-ab5b-803ecb551a17 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.138473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd1be4-d479-444c-ab5b-803ecb551a17 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.138744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd1be4-d479-444c-ab5b-803ecb551a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.140641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e1bca-2319-44f7-91e8-2b194872e78a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.145435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.146170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.146394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.146673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.147410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.149087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.157425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-94fd1be4-d479-444c-ab5b-803ecb551a17 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:04.158800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-94fd1be4-d479-444c-ab5b-803ecb551a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.159844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1100/2195] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:33:04.163883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.168452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1096/2196] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:04.172513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd1be4-d479-444c-ab5b-803ecb551a17 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.173717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97423-863c-4240-ab1c-6e827c574bfd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.178918 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.179572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.179851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.180133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.180878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.182139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd1be4-d479-444c-ab5b-803ecb551a17 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.182479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.186937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.187582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.187936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.188223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.188974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:04.189288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.190892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.196184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1101/2197] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:33:04.196740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.201687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:04.206002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1097/2198] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:04.206967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cdfaf-d499-4a67-a97d-7bebe6834696 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.210424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.213226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ea288-bc63-4876-a664-bbf5370c58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.214135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea288-bc63-4876-a664-bbf5370c58e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.214414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea288-bc63-4876-a664-bbf5370c58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.214688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea288-bc63-4876-a664-bbf5370c58e4 admin admin] PATH_INFO: `/v3/projects/07ddb25f97f34e66a59b44e33926fc1e/users/475db603aa7d4f88b18147c28660965d/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.220442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55a4f-3679-4cea-bfb1-4cfb89f1efb1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.225435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.226119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.226430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.226711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.227398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.229362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.230828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ea288-bc63-4876-a664-bbf5370c58e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ddb25f97f34e66a59b44e33926fc1e, user_id=475db603aa7d4f88b18147c28660965d, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.233495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ea288-bc63-4876-a664-bbf5370c58e4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.247293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1102/2199] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:04 2022] PUT /identity/v3/projects/07ddb25f97f34e66a59b44e33926fc1e/users/475db603aa7d4f88b18147c28660965d/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:04.258218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1098/2200] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:04.259330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125916f-0b0d-49c4-b5ed-39d5140d479b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.259755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125916f-0b0d-49c4-b5ed-39d5140d479b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.260033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125916f-0b0d-49c4-b5ed-39d5140d479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.262084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.288577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2125916f-0b0d-49c4-b5ed-39d5140d479b None None] MFA Rules not processed for user `475db603aa7d4f88b18147c28660965d`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:04.289827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2125916f-0b0d-49c4-b5ed-39d5140d479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.331196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c28ec-5a67-4531-8186-dde3e42d040b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.338468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.339193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.339481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.339727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.340561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.342522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.366754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1103/2201] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:04.372350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1099/2202] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:04.373262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125916f-0b0d-49c4-b5ed-39d5140d479b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.376117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.389797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125916f-0b0d-49c4-b5ed-39d5140d479b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.389925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265a803-a00b-4189-bafb-05159dc62946 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.395022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.395176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.395950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.396260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.396371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.396487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.396781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.396905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.397681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.397786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.399536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.399795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.411642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1100/2203] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:04.414403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.426512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e51e1-4eb3-4385-a5b5-354a4a1fa46b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.436616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.438174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.438608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.439032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.439999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.441876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.442498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1104/2204] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:04.446901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.461574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1101/2205] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:33:04.468601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.481141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312daf6-81b5-4617-95b1-182d4c3938e2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.519346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcdf62-bfb1-42df-937d-38b7d729981d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.524161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.524888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.525176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.525453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.526167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.528368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.547186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:04.555989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1105/2206] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:04.555989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.556574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.559512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.560161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.560559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.561015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] PATH_INFO: `/v3/projects/d24683400fc7456686d8f430a84735a2/users/3f72831b502b46a8b5b64c2fe729d1e3/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.574553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d21a1-09bc-4a52-8ad2-70df9fceb918 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.578134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24683400fc7456686d8f430a84735a2, user_id=3f72831b502b46a8b5b64c2fe729d1e3, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.579432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.580326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.580610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.580926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] PATH_INFO: `/v3/users/fe56be7b494d4e3d87a7be8b444b1493` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.581386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.582196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe56be7b494d4e3d87a7be8b444b1493)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.584304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.600334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1102/2207] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:04 2022] PUT /identity/v3/projects/d24683400fc7456686d8f430a84735a2/users/3f72831b502b46a8b5b64c2fe729d1e3/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:04.605977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.633732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:04.643024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe56be7b494d4e3d87a7be8b444b1493'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.651037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe56be7b494d4e3d87a7be8b444b1493'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.651686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe56be7b494d4e3d87a7be8b444b1493'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.652294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe56be7b494d4e3d87a7be8b444b1493'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.666024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edfba1c3-873d-49c8-89d9-f66e09c94737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe56be7b494d4e3d87a7be8b444b1493'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:04.672733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3eb7c4-5df4-46ed-a2aa-fdef7e50080b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.678406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacff08-c7ac-4afd-821d-a72063bd82fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.679078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacff08-c7ac-4afd-821d-a72063bd82fe admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.679380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacff08-c7ac-4afd-821d-a72063bd82fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.679657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacff08-c7ac-4afd-821d-a72063bd82fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.679822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1106/2208] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:04 2022] DELETE /identity/v3/users/fe56be7b494d4e3d87a7be8b444b1493 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:04.680373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacff08-c7ac-4afd-821d-a72063bd82fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.682013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacff08-c7ac-4afd-821d-a72063bd82fe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.682121 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.682495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.682822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.692702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1103/2209] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:04.693980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.694256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.694530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.701515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:04.702716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.711705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:04.712924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.763215 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1107/2210] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:04.764188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.765602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.772798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1104/2211] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:04.773653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.775044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.781042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6716cc-b41f-46a9-bc92-e51832fc97ce None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.786536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.787522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.787872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.788147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] PATH_INFO: `/v3/projects/df742f63c789465bacaff5af448106d1/users/31a09d276c354e6a8de5b4939bf02bac/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.803842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df742f63c789465bacaff5af448106d1, user_id=31a09d276c354e6a8de5b4939bf02bac, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.806532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.819999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1108/2212] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:04 2022] PUT /identity/v3/projects/df742f63c789465bacaff5af448106d1/users/31a09d276c354e6a8de5b4939bf02bac/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:04.820871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.822558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:04.838175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568a954-e1a7-409d-b104-4006b3150cc9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.866688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:04.881746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29b2b1-8186-4fb0-b921-e2d735f0c31f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.885560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.886256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.886658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.887006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.891898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.892562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.892884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.893166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.925174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:04.948513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.950094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.955445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.956950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.960685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1109/2213] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:04.961515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:04.968499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1105/2214] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:04.970914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3729a7-6d38-4a04-ab73-8eff2cd22053 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:04.975920 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2456a-b065-4c26-a459-577bd34df8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:04.976590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2456a-b065-4c26-a459-577bd34df8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:04.976946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2456a-b065-4c26-a459-577bd34df8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:04.977223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2456a-b065-4c26-a459-577bd34df8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:04.977949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2456a-b065-4c26-a459-577bd34df8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:04.979575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2456a-b065-4c26-a459-577bd34df8e6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:04.993173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1110/2215] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:04.994523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:05.004659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16084b-98d2-4a63-9ad2-b2b0557340b5 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:05.009718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:05.010845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.011233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.011545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] PATH_INFO: `/v3/projects/df742f63c789465bacaff5af448106d1/users/31a09d276c354e6a8de5b4939bf02bac/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.014063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df742f63c789465bacaff5af448106d1, user_id=31a09d276c354e6a8de5b4939bf02bac, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:05.016998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:05.027667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1106/2216] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:04 2022] PUT /identity/v3/projects/df742f63c789465bacaff5af448106d1/users/31a09d276c354e6a8de5b4939bf02bac/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:05.038425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.038947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.039196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.072051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] MFA Rules not processed for user `31a09d276c354e6a8de5b4939bf02bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:05.073437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:05.149952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1111/2217] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:05.164154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:05.166177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:05.257572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e5194-368b-497c-b9ad-f3da4469696b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:05.265705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcac765-20c2-44a4-8a5b-fd2315bbf5d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:05.266558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac765-20c2-44a4-8a5b-fd2315bbf5d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.266852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac765-20c2-44a4-8a5b-fd2315bbf5d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.267272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcac765-20c2-44a4-8a5b-fd2315bbf5d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.269621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bfcac765-20c2-44a4-8a5b-fd2315bbf5d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:05.354316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcac765-20c2-44a4-8a5b-fd2315bbf5d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:05.356291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcac765-20c2-44a4-8a5b-fd2315bbf5d3 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:05.368216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1107/2218] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:05.462210 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:05.463779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:05.562206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54726e-f9ec-48ae-a88f-cfd7dd41f561 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:05.568186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:05.569289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.569665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.570624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] PATH_INFO: `/v3/projects/a1e946f8e5c34801a3932718fcd09162` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.572638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e946f8e5c34801a3932718fcd09162)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:05.575453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:05.633478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e946f8e5c34801a3932718fcd09162', 'request_id': 'req-f12a5a84-61dc-48ff-b013-2abaffe15549'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:05.634909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:05.643153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e946f8e5c34801a3932718fcd09162', 'request_id': 'req-f12a5a84-61dc-48ff-b013-2abaffe15549'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:05.656640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e946f8e5c34801a3932718fcd09162', 'request_id': 'req-f12a5a84-61dc-48ff-b013-2abaffe15549'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:05.671004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] The token cache is being invalidate because project a1e946f8e5c34801a3932718fcd09162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:05.671386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:05.672119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f12a5a84-61dc-48ff-b013-2abaffe15549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:05.674429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1112/2219] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:05 2022] DELETE /identity/v3/projects/a1e946f8e5c34801a3932718fcd09162 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:05.680330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aad14-8f15-4b11-82ff-be88732c5ea4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.681297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aad14-8f15-4b11-82ff-be88732c5ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.682311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00aad14-8f15-4b11-82ff-be88732c5ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.712892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c00aad14-8f15-4b11-82ff-be88732c5ea4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:05.714441 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c00aad14-8f15-4b11-82ff-be88732c5ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:05.741053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:05.816208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1108/2220] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:05.818720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2834f-9e67-4865-8aaa-d4ea720e8b82 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.819222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2834f-9e67-4865-8aaa-d4ea720e8b82 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.819684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2834f-9e67-4865-8aaa-d4ea720e8b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.841804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2bc2834f-9e67-4865-8aaa-d4ea720e8b82 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:05.843514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2bc2834f-9e67-4865-8aaa-d4ea720e8b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:05.854151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1113/2221] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:05.858735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aad14-8f15-4b11-82ff-be88732c5ea4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:05.871192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00aad14-8f15-4b11-82ff-be88732c5ea4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:05.877042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:05.877745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.878001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.878272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.879014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:05.880212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:05.881904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:05.896246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1109/2222] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:05.900325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2834f-9e67-4865-8aaa-d4ea720e8b82 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:05.911811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2834f-9e67-4865-8aaa-d4ea720e8b82 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:05.918202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91740de-c9fe-4736-865e-be4a324fb5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:05.919437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91740de-c9fe-4736-865e-be4a324fb5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:05.919866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91740de-c9fe-4736-865e-be4a324fb5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:05.920328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91740de-c9fe-4736-865e-be4a324fb5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:05.921268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91740de-c9fe-4736-865e-be4a324fb5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:05.923622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91740de-c9fe-4736-865e-be4a324fb5ce admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:05.961511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1114/2223] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:05 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:05.966065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:05.979339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96807b5b-aec6-48f6-b575-2d1859763726 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.075213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.076094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.076661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.081814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.082890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.083181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.083577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.084290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.086422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.116233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] MFA Rules not processed for user `3f72831b502b46a8b5b64c2fe729d1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:06.117844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:06.126209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1110/2224] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:05 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:06.130703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.141700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d295d-c3f5-4715-9c2a-573d3e6b670c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.148057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.148750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.149046 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.149366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.150151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.151963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.168160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1111/2225] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:06.169736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.183969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc20441-80d5-462a-99e5-efe324f1d9be admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.189473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.190487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.190487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.190788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.191515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.193922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.207794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1112/2226] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:06.213140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.218975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1115/2227] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:06.224514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.225934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:06.228665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20d7da-a564-42f1-aad7-52042e44bc0b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.233731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b46ce6-8464-4473-bfb0-6f5e292dd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.234685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46ce6-8464-4473-bfb0-6f5e292dd333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.234973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46ce6-8464-4473-bfb0-6f5e292dd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.235297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b46ce6-8464-4473-bfb0-6f5e292dd333 admin admin] PATH_INFO: `/v3/projects/22a2f33b69e1494396f3c2912e31b3fa/users/586b4f81aeb84808901d6d9167594a1e/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.242388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464f4fe-bd48-4da1-b5b6-44df235211bf None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.260429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b46ce6-8464-4473-bfb0-6f5e292dd333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a2f33b69e1494396f3c2912e31b3fa, user_id=586b4f81aeb84808901d6d9167594a1e, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.266171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.266886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.267217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.267498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.268602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.270838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.271105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b46ce6-8464-4473-bfb0-6f5e292dd333 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.298986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1113/2228] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:06 2022] PUT /identity/v3/projects/22a2f33b69e1494396f3c2912e31b3fa/users/586b4f81aeb84808901d6d9167594a1e/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:06.304969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.305486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.308401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1116/2229] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:06 2022] POST /identity/v3/projects => generated 403 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:06.312012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.313301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.335072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:06.336307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:06.389520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b954e26-0aac-4a9f-a431-65ba49bf9157 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.394363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.395346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.395464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.395675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.396408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.398382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.407389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:06.424553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1117/2230] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:06 2022] POST /identity/v3/users => generated 308 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:06.428963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1114/2231] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:06.430012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.442186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4533d2-73c5-4575-b908-623f5b8935da admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.445824 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.447453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:06.450401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.451106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.451394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.451671 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.452417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.454401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.456759 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:06.469292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1118/2232] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:33:06.474172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.487596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d32f5e-44ad-4bb9-b358-2fb8a513317d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.497423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.499702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.500000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.500284 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] PATH_INFO: `/v3/projects/d479bcbd29844f00baca0421f58362d8/users/ce78a08bfc3f446684d50d4aa763ae45/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.521656 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d479bcbd29844f00baca0421f58362d8, user_id=ce78a08bfc3f446684d50d4aa763ae45, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.524569 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.531630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332f432-2ca2-4274-8178-3c8b0b3b2b95 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.536374 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.537340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.537626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.537900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.546061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1119/2233] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:06 2022] PUT /identity/v3/projects/d479bcbd29844f00baca0421f58362d8/users/ce78a08bfc3f446684d50d4aa763ae45/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:06.547774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.549953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.552332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.563479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1115/2234] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:06.633084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5979c-d510-41d9-b720-7c1ef1e82fab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.639421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.640396 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.640979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.641191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.642093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.644252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.656440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1120/2235] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:06.661077 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:06.673264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18a5cf-9bf5-474c-a415-75e3eeaaf4da service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:06.679770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9004b4f-603e-478f-9f08-548a75675d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:06.680672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004b4f-603e-478f-9f08-548a75675d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:06.681275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004b4f-603e-478f-9f08-548a75675d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:06.681354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004b4f-603e-478f-9f08-548a75675d8c admin admin] PATH_INFO: `/v3/projects/d479bcbd29844f00baca0421f58362d8/users/ce78a08bfc3f446684d50d4aa763ae45/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:06.683263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004b4f-603e-478f-9f08-548a75675d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d479bcbd29844f00baca0421f58362d8, user_id=ce78a08bfc3f446684d50d4aa763ae45, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:06.686002 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004b4f-603e-478f-9f08-548a75675d8c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:06.697860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1116/2236] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:06 2022] PUT /identity/v3/projects/d479bcbd29844f00baca0421f58362d8/users/ce78a08bfc3f446684d50d4aa763ae45/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:07.008523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:07.011550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:07.093683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5eb70-5f5e-47e9-b6f1-b6e42b5d42b4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:07.168750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290beac-8603-43a9-89ab-0e8f788b08c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:07.169793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290beac-8603-43a9-89ab-0e8f788b08c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:07.169938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290beac-8603-43a9-89ab-0e8f788b08c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:07.170277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290beac-8603-43a9-89ab-0e8f788b08c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:07.172652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f290beac-8603-43a9-89ab-0e8f788b08c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:07.231028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:07.270585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290beac-8603-43a9-89ab-0e8f788b08c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:07.273817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290beac-8603-43a9-89ab-0e8f788b08c6 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:07.282454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:07.282753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:07.283032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:07.288491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1121/2237] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:07.320540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] MFA Rules not processed for user `586b4f81aeb84808901d6d9167594a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:07.323026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:07.425026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1117/2238] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:07.531308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716960c-1b8c-4a36-a9de-57c43eb7839d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:07.531777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716960c-1b8c-4a36-a9de-57c43eb7839d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:07.532127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716960c-1b8c-4a36-a9de-57c43eb7839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:07.582900 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4716960c-1b8c-4a36-a9de-57c43eb7839d None None] MFA Rules not processed for user `ce78a08bfc3f446684d50d4aa763ae45`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:07.584649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4716960c-1b8c-4a36-a9de-57c43eb7839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:07.609637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:07.613029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:07.639699 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061957d2-64a8-4481-b957-0b7adbcf2f51 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:07.648297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:07.649617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:07.650454 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:07.651228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:07.678095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:07.679548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:07.702171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1118/2239] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:07.751932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1122/2240] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:08.110533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:08.121211 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23281769-7ae5-4b26-bd99-1282d643ad59 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:08.126430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb08499-c370-4e79-9ad4-2222dd6afccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:08.127913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08499-c370-4e79-9ad4-2222dd6afccf service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:08.128310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08499-c370-4e79-9ad4-2222dd6afccf service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:08.128697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08499-c370-4e79-9ad4-2222dd6afccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:08.130881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0fb08499-c370-4e79-9ad4-2222dd6afccf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:08.186623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716960c-1b8c-4a36-a9de-57c43eb7839d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:08.198679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716960c-1b8c-4a36-a9de-57c43eb7839d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:08.203629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63030ec2-6173-45d8-a43a-db89297c7339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:08.204744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63030ec2-6173-45d8-a43a-db89297c7339 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:08.205821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63030ec2-6173-45d8-a43a-db89297c7339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:08.206050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63030ec2-6173-45d8-a43a-db89297c7339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:08.208036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-63030ec2-6173-45d8-a43a-db89297c7339 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:08.212439 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:08.215876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb08499-c370-4e79-9ad4-2222dd6afccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:08.217979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb08499-c370-4e79-9ad4-2222dd6afccf service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:08.231936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1119/2241] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:08.288590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63030ec2-6173-45d8-a43a-db89297c7339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:08.290091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63030ec2-6173-45d8-a43a-db89297c7339 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:08.304281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1123/2242] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:08.412367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb474c-1886-4e50-aab9-427b04cb793c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:08.412627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb474c-1886-4e50-aab9-427b04cb793c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:08.413162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb474c-1886-4e50-aab9-427b04cb793c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:08.414883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1120/2243] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:33:08.425118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b35a-2827-4fca-8a7c-fdd3255d3f51 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:08.427229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b35a-2827-4fca-8a7c-fdd3255d3f51 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:08.427229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9b35a-2827-4fca-8a7c-fdd3255d3f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:08.447586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cdf9b35a-2827-4fca-8a7c-fdd3255d3f51 None None] MFA Rules not processed for user `5411be02252b4749be7e1a06d7ddcb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:08.448906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cdf9b35a-2827-4fca-8a7c-fdd3255d3f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:08.523612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:08.539113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1124/2244] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:33:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:08.551401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb474c-1886-4e50-aab9-427b04cb793c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:08.553448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4ecb474c-1886-4e50-aab9-427b04cb793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:08.572298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb474c-1886-4e50-aab9-427b04cb793c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:08.577595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:08.578279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:08.578563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:08.578831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:08.587765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:08.589400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:08.601426 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1121/2245] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:09.195341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:09.196507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1de65-7003-4f89-927a-d14bb49ebe85 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:09.196992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1de65-7003-4f89-927a-d14bb49ebe85 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:09.197277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1de65-7003-4f89-927a-d14bb49ebe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:09.216174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0fa1de65-7003-4f89-927a-d14bb49ebe85 None None] MFA Rules not processed for user `586b4f81aeb84808901d6d9167594a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:09.217774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0fa1de65-7003-4f89-927a-d14bb49ebe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:09.229637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1125/2246] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:09.275671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc85b65-77b1-4398-9a3b-a9206a39fd0a service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:09.280577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:09.281532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:09.281850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:09.282125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] PATH_INFO: `/v3/users/3f72831b502b46a8b5b64c2fe729d1e3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:09.283326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f72831b502b46a8b5b64c2fe729d1e3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:09.285322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:09.351724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f72831b502b46a8b5b64c2fe729d1e3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.359312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f72831b502b46a8b5b64c2fe729d1e3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.360023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f72831b502b46a8b5b64c2fe729d1e3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.360643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f72831b502b46a8b5b64c2fe729d1e3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.376902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f72831b502b46a8b5b64c2fe729d1e3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.396995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1122/2247] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:09 2022] DELETE /identity/v3/users/3f72831b502b46a8b5b64c2fe729d1e3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:09.630686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1de65-7003-4f89-927a-d14bb49ebe85 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:09.644501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1de65-7003-4f89-927a-d14bb49ebe85 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:09.756172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:09.757709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:09.758342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:09.758651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] PATH_INFO: `/v3/projects/d24683400fc7456686d8f430a84735a2` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:09.760413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24683400fc7456686d8f430a84735a2)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:09.763478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:09.836836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24683400fc7456686d8f430a84735a2', 'request_id': 'req-5accdafb-ec3f-4490-90fc-73315dc2cbae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.845151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24683400fc7456686d8f430a84735a2', 'request_id': 'req-5accdafb-ec3f-4490-90fc-73315dc2cbae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.858331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24683400fc7456686d8f430a84735a2', 'request_id': 'req-5accdafb-ec3f-4490-90fc-73315dc2cbae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.886816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] The token cache is being invalidate because project d24683400fc7456686d8f430a84735a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:09.887343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.888450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:09.890449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1126/2248] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:09 2022] DELETE /identity/v3/projects/d24683400fc7456686d8f430a84735a2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:09.894511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:09.896743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:09.910758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3c5bc-aba1-4cee-af5b-2733b58f6561 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:09.982531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:09.983555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:09.983642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:09.983890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] PATH_INFO: `/v3/users/ce78a08bfc3f446684d50d4aa763ae45` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:09.985208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce78a08bfc3f446684d50d4aa763ae45)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:09.987215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:09.989136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:10.040564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce78a08bfc3f446684d50d4aa763ae45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.048459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce78a08bfc3f446684d50d4aa763ae45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.049284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce78a08bfc3f446684d50d4aa763ae45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.049982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce78a08bfc3f446684d50d4aa763ae45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.070562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4f02a41-9210-48e3-80e2-35c6e0f4c71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce78a08bfc3f446684d50d4aa763ae45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.084432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1123/2249] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:09 2022] DELETE /identity/v3/users/ce78a08bfc3f446684d50d4aa763ae45 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:10.281090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:10.282750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:10.296621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accdafb-ec3f-4490-90fc-73315dc2cbae admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:10.375889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:10.376815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.377104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.377369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] PATH_INFO: `/v3/projects/d479bcbd29844f00baca0421f58362d8` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.378653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d479bcbd29844f00baca0421f58362d8)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:10.380813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:10.402321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:10.430450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd479bcbd29844f00baca0421f58362d8', 'request_id': 'req-acbdafd3-bf61-4961-b292-2467511c7354'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.436702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd479bcbd29844f00baca0421f58362d8', 'request_id': 'req-acbdafd3-bf61-4961-b292-2467511c7354'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.445036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd479bcbd29844f00baca0421f58362d8', 'request_id': 'req-acbdafd3-bf61-4961-b292-2467511c7354'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.456576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] The token cache is being invalidate because project d479bcbd29844f00baca0421f58362d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:10.456970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.457782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-acbdafd3-bf61-4961-b292-2467511c7354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:10.459333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1127/2250] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:10 2022] DELETE /identity/v3/projects/d479bcbd29844f00baca0421f58362d8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:10.464370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae0dd-88e9-4fec-bb5f-e2cd2516c64c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.464895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae0dd-88e9-4fec-bb5f-e2cd2516c64c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.464983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae0dd-88e9-4fec-bb5f-e2cd2516c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.483954 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5e2ae0dd-88e9-4fec-bb5f-e2cd2516c64c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:10.485205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e2ae0dd-88e9-4fec-bb5f-e2cd2516c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:10.548980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1124/2251] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:10.557290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f269e-f351-4d4f-9f71-3c639441726b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.557580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f269e-f351-4d4f-9f71-3c639441726b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.557857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f269e-f351-4d4f-9f71-3c639441726b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.577729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d70f269e-f351-4d4f-9f71-3c639441726b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:10.578864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d70f269e-f351-4d4f-9f71-3c639441726b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:10.588446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1128/2252] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:10.593045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ae0dd-88e9-4fec-bb5f-e2cd2516c64c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:10.603040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ae0dd-88e9-4fec-bb5f-e2cd2516c64c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:10.607928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:10.608591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.608914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.609189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.609926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:10.610238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:10.611845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:10.623914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1125/2253] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:10.628384 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f269e-f351-4d4f-9f71-3c639441726b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:10.639926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f269e-f351-4d4f-9f71-3c639441726b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:10.647608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:10.648949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.649270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.649552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.650267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:10.652249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:10.680157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1129/2254] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:10 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:10.684043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:10.694730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e7929-60e9-4e97-a883-fc4bbd9ca1a4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:10.755383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:10.756041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.756356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.756632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.757387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:10.759313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:10.769901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:10.782694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1126/2255] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:10 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:10.786553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:10.797080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a1c3-c928-4e57-be59-3efc235e6227 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:10.803024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:10.803797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.804137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.804477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.805329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:10.807000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:10.818014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1130/2256] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:10.821927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:10.832392 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97eaee0-bc8c-4ded-808c-02213d4856f1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:10.838003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140694-e61b-413e-8beb-115a602b1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:10.838792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140694-e61b-413e-8beb-115a602b1eed admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.839127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140694-e61b-413e-8beb-115a602b1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.839401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140694-e61b-413e-8beb-115a602b1eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.840159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140694-e61b-413e-8beb-115a602b1eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:10.841764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140694-e61b-413e-8beb-115a602b1eed admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:10.852421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1127/2257] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:10.856389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:10.866969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e231ec-0b78-4a1d-a6f6-b4d3c6f6d73e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:10.872287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:10.873196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.873506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.873744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] PATH_INFO: `/v3/projects/31272e2dc1f04186860587cb7f298810/users/5322537a1453472dadc0a23835cd7ab6/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.894369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31272e2dc1f04186860587cb7f298810, user_id=5322537a1453472dadc0a23835cd7ab6, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:10.898115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:10.915609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1131/2258] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:10 2022] PUT /identity/v3/projects/31272e2dc1f04186860587cb7f298810/users/5322537a1453472dadc0a23835cd7ab6/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:10.927307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491242f-7e7c-48b7-943d-bfaf81ba7108 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:10.927307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491242f-7e7c-48b7-943d-bfaf81ba7108 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:10.927717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491242f-7e7c-48b7-943d-bfaf81ba7108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:10.957473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5491242f-7e7c-48b7-943d-bfaf81ba7108 None None] MFA Rules not processed for user `5322537a1453472dadc0a23835cd7ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:10.958839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5491242f-7e7c-48b7-943d-bfaf81ba7108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:11.039404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1128/2259] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:11.040116 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:11.159476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a215-98c4-4e78-8dfa-4439a17355a7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:11.166218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:11.167122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.167996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.167996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.168670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:11.170851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:11.239502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1132/2260] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:11 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:11.241118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491242f-7e7c-48b7-943d-bfaf81ba7108 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:11.257434 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491242f-7e7c-48b7-943d-bfaf81ba7108 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:11.336951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:11.337338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.337600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.337871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.339020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:11.344183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:11.385919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1129/2261] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:11 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:11.389967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:11.405787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560eb15-26dd-4dfc-858f-72017a4627d8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:11.418288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:11.419291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.420108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.420669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.421862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:11.424061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:11.440574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1133/2262] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:11.445566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:11.470499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b633db-ddf0-4ab5-91d9-55d0ce8560a3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:11.480260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:11.481361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.481652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.482003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] PATH_INFO: `/v3/projects/2b935b1581c3439fbf86f1c3d43dfda0/users/c735ad442131447e8a05e01d9c0ee23c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.503575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b935b1581c3439fbf86f1c3d43dfda0, user_id=c735ad442131447e8a05e01d9c0ee23c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:11.515253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:11.544496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1130/2263] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:11 2022] PUT /identity/v3/projects/2b935b1581c3439fbf86f1c3d43dfda0/users/c735ad442131447e8a05e01d9c0ee23c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:11.549340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:11.561343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b645e-f073-4c1e-adb6-3fad718cee8e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:11.577640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:11.636251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a87f16-9a5f-458a-b910-d254cd296e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:11.637220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87f16-9a5f-458a-b910-d254cd296e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.637344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87f16-9a5f-458a-b910-d254cd296e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.637529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a87f16-9a5f-458a-b910-d254cd296e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.638273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a87f16-9a5f-458a-b910-d254cd296e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:11.639980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a87f16-9a5f-458a-b910-d254cd296e2c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:11.652769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1134/2264] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:11.656775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:11.671478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080042b9-43b2-430f-8909-244dc436266e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:11.677284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:11.678352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.678747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.679010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] PATH_INFO: `/v3/projects/2b935b1581c3439fbf86f1c3d43dfda0/users/c735ad442131447e8a05e01d9c0ee23c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.681171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b935b1581c3439fbf86f1c3d43dfda0, user_id=c735ad442131447e8a05e01d9c0ee23c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:11.683958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:11.696793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1131/2265] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:11 2022] PUT /identity/v3/projects/2b935b1581c3439fbf86f1c3d43dfda0/users/c735ad442131447e8a05e01d9c0ee23c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:11.708409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.708772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.709017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.747698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] MFA Rules not processed for user `c735ad442131447e8a05e01d9c0ee23c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:11.749071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:11.844925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1135/2266] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:11 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:11.850222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:11.852125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:11.894282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:11.926934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0e824-aa57-4952-9ba8-e84b69c9dfe7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:11.930965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:11.931645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:11.931930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:11.932205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:11.942995 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:11.945517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:11.956868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1132/2267] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:11 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:12.006046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:12.007581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:12.021111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007119-7b9f-45ce-86ab-b199e83e85b6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:12.024937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4fa71-177f-4a78-b07f-df7f7d017f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:12.025598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4fa71-177f-4a78-b07f-df7f7d017f4b service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:12.025882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4fa71-177f-4a78-b07f-df7f7d017f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:12.026162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4fa71-177f-4a78-b07f-df7f7d017f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:12.096467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4fa71-177f-4a78-b07f-df7f7d017f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:12.098347 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4fa71-177f-4a78-b07f-df7f7d017f4b service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:12.113919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1136/2268] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:12.580066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:12.581535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:12.691892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6faac3-9fd3-4229-accd-d566e4c99f1d service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:12.696955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:12.698661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:12.699245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:12.699658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] PATH_INFO: `/v3/users/a63046661e5f4ed2be56649bd70df628` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:12.701305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63046661e5f4ed2be56649bd70df628)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:12.703451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:12.780462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63046661e5f4ed2be56649bd70df628'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:12.788327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63046661e5f4ed2be56649bd70df628'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:12.789045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63046661e5f4ed2be56649bd70df628'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:12.789661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63046661e5f4ed2be56649bd70df628'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:12.806027 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63046661e5f4ed2be56649bd70df628'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:12.834359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1133/2269] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:12 2022] DELETE /identity/v3/users/a63046661e5f4ed2be56649bd70df628 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:12.838891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:12.839388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:12.839478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:12.856766 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:12.857993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:12.898825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:12.929514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1137/2270] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:12.939909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:12.941686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:12.996645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:13.000501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e7e01-280b-4a2d-892f-2c6025e0ba2c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:13.005286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:13.006171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:13.006613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:13.007255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:13.017265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:13.018738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:13.029733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1134/2271] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:13.303784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:13.305365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:13.320491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce50bc-ad16-4563-bfb5-90c98931cd78 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:13.325686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:13.326630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:13.326915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:13.327187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] PATH_INFO: `/v3/projects/ac89e65e69664ca4b08a21dae10ed0de` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:13.328779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac89e65e69664ca4b08a21dae10ed0de)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:13.331013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:13.380993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac89e65e69664ca4b08a21dae10ed0de', 'request_id': 'req-fad58905-0393-43d0-8ade-680933b72c4c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.388823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac89e65e69664ca4b08a21dae10ed0de', 'request_id': 'req-fad58905-0393-43d0-8ade-680933b72c4c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.398132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac89e65e69664ca4b08a21dae10ed0de', 'request_id': 'req-fad58905-0393-43d0-8ade-680933b72c4c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.411067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] The token cache is being invalidate because project ac89e65e69664ca4b08a21dae10ed0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:13.411583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.412148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.413983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1138/2272] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:13 2022] DELETE /identity/v3/projects/ac89e65e69664ca4b08a21dae10ed0de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:13.417869 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:13.428146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e38070-f385-432a-8fb9-6d7221d39e91 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:13.511909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:13.512948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:13.513298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:13.513645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] PATH_INFO: `/v3/users/475db603aa7d4f88b18147c28660965d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:13.517583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=475db603aa7d4f88b18147c28660965d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:13.519614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:13.580055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '475db603aa7d4f88b18147c28660965d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.587776 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '475db603aa7d4f88b18147c28660965d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.588487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '475db603aa7d4f88b18147c28660965d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.589097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '475db603aa7d4f88b18147c28660965d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.603043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '475db603aa7d4f88b18147c28660965d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:13.625733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1135/2273] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:13 2022] DELETE /identity/v3/users/475db603aa7d4f88b18147c28660965d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:14.171840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:14.173940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:14.200629 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58905-0393-43d0-8ade-680933b72c4c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:14.282580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:14.283638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:14.283923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:14.284265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] PATH_INFO: `/v3/projects/07ddb25f97f34e66a59b44e33926fc1e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:14.285785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ddb25f97f34e66a59b44e33926fc1e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:14.288162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:14.342369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ddb25f97f34e66a59b44e33926fc1e', 'request_id': 'req-cf38917f-71d0-4bf1-ba4b-ccde61145303'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.348883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ddb25f97f34e66a59b44e33926fc1e', 'request_id': 'req-cf38917f-71d0-4bf1-ba4b-ccde61145303'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.358531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ddb25f97f34e66a59b44e33926fc1e', 'request_id': 'req-cf38917f-71d0-4bf1-ba4b-ccde61145303'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.360596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:14.370305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] The token cache is being invalidate because project 07ddb25f97f34e66a59b44e33926fc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:14.370844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.371844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.373526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1139/2274] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:14 2022] DELETE /identity/v3/projects/07ddb25f97f34e66a59b44e33926fc1e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:14.377696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:14.379273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:14.391967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709a94-45fa-4f75-ae4d-dcb2f66cf5da admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:14.449054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:14.449936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:14.450188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:14.450501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] PATH_INFO: `/v3/users/31a09d276c354e6a8de5b4939bf02bac` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:14.452153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a09d276c354e6a8de5b4939bf02bac)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:14.455135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:14.470653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:14.510793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a09d276c354e6a8de5b4939bf02bac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.518444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a09d276c354e6a8de5b4939bf02bac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.519127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a09d276c354e6a8de5b4939bf02bac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.519828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a09d276c354e6a8de5b4939bf02bac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.532265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ee734718-0987-4a58-882f-0e88c7222434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a09d276c354e6a8de5b4939bf02bac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:14.546680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1136/2275] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:14 2022] DELETE /identity/v3/users/31a09d276c354e6a8de5b4939bf02bac => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:14.921145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:14.922775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:14.936756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38917f-71d0-4bf1-ba4b-ccde61145303 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.011520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.012323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.012603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.013298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] PATH_INFO: `/v3/projects/df742f63c789465bacaff5af448106d1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.014612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df742f63c789465bacaff5af448106d1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.016550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.074806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df742f63c789465bacaff5af448106d1', 'request_id': 'req-8807cab6-256f-44bf-81ce-5c195ccc5df5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:15.082300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df742f63c789465bacaff5af448106d1', 'request_id': 'req-8807cab6-256f-44bf-81ce-5c195ccc5df5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:15.090190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df742f63c789465bacaff5af448106d1', 'request_id': 'req-8807cab6-256f-44bf-81ce-5c195ccc5df5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:15.101133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] The token cache is being invalidate because project df742f63c789465bacaff5af448106d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:15.101422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:15.102049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8807cab6-256f-44bf-81ce-5c195ccc5df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:15.103828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1140/2276] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:14 2022] DELETE /identity/v3/projects/df742f63c789465bacaff5af448106d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:15.109025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e26360-1a2d-4402-915d-453e1b1709ea None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.109948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e26360-1a2d-4402-915d-453e1b1709ea None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.110300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e26360-1a2d-4402-915d-453e1b1709ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.131898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f2e26360-1a2d-4402-915d-453e1b1709ea None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:15.133276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f2e26360-1a2d-4402-915d-453e1b1709ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:15.205501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1137/2277] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:15.213235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f7835-24cd-4f61-aee3-102c4a010bbb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.213640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f7835-24cd-4f61-aee3-102c4a010bbb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.213816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f7835-24cd-4f61-aee3-102c4a010bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.233888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f18f7835-24cd-4f61-aee3-102c4a010bbb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:15.235110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f18f7835-24cd-4f61-aee3-102c4a010bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:15.256268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1141/2278] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:15.261051 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e26360-1a2d-4402-915d-453e1b1709ea None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.275550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e26360-1a2d-4402-915d-453e1b1709ea None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.283458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.284620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.285253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.285740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.286767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:15.287711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.289429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.313346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1138/2279] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:15.317527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f7835-24cd-4f61-aee3-102c4a010bbb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.330831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f7835-24cd-4f61-aee3-102c4a010bbb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.351029 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.351720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.352004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.352277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.353013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.354976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.405819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1142/2280] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:15.410263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.421323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b6d8d-3a4e-4205-8f6a-711994103aaa admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.489915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.491055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.491495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.491773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.492495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.494635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.520905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1139/2281] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:15 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:15.525367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.538485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db015e8a-10eb-4c99-b377-2531135f4497 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.547093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.548342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.548951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.551106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.553625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.557428 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.571406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1143/2282] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:15.588300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.624336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa2cb8-b5c6-47fb-8022-52a98d82cca9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.633347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c60d55-db4d-4c57-9bd4-5a966258a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.634040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c60d55-db4d-4c57-9bd4-5a966258a758 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.634325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c60d55-db4d-4c57-9bd4-5a966258a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.634600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c60d55-db4d-4c57-9bd4-5a966258a758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.635343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c60d55-db4d-4c57-9bd4-5a966258a758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.637634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c60d55-db4d-4c57-9bd4-5a966258a758 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.639720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:15.655834 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1140/2283] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:15.657175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.667275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec10505-cba4-462a-9e6c-99513c8dcd5f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.671945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.672880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.673168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.673454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] PATH_INFO: `/v3/projects/e14fab80ba0044d5a9875ab6920b9e39/users/50ca1fcef6174c7e812077408449f9d0/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.690667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14fab80ba0044d5a9875ab6920b9e39, user_id=50ca1fcef6174c7e812077408449f9d0, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.693621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.708331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1144/2284] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:15 2022] PUT /identity/v3/projects/e14fab80ba0044d5a9875ab6920b9e39/users/50ca1fcef6174c7e812077408449f9d0/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:15.713365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.713758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.714078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.734719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:15.736144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:15.814679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1141/2285] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:15.828142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.832931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:15.862102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:15.913406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1628b-073b-4820-9a41-8697018e072c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.919137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed82596-d62d-4845-83db-70d219210593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.919931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed82596-d62d-4845-83db-70d219210593 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.920246 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed82596-d62d-4845-83db-70d219210593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.920529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed82596-d62d-4845-83db-70d219210593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.936995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed82596-d62d-4845-83db-70d219210593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.938664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed82596-d62d-4845-83db-70d219210593 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:15.948985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:15.950952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:15.955670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1145/2286] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:15.966713 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659974c2-ed1b-4f90-a56d-b0ccb28f0ace None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:15.982377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:15.983460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:15.983741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:15.984015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] PATH_INFO: `/v3/users/5322537a1453472dadc0a23835cd7ab6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:15.985468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5322537a1453472dadc0a23835cd7ab6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:15.987591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:16.036967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5322537a1453472dadc0a23835cd7ab6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.044353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5322537a1453472dadc0a23835cd7ab6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.045174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5322537a1453472dadc0a23835cd7ab6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.045760 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5322537a1453472dadc0a23835cd7ab6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.061326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5322537a1453472dadc0a23835cd7ab6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.075835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1142/2287] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:15 2022] DELETE /identity/v3/users/5322537a1453472dadc0a23835cd7ab6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:16.080843 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:16.081516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:16.081516 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:16.099556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:16.101024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:16.166457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1146/2288] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:16.176994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:16.178336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:16.248040 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5c637-5615-461e-b48c-6ade601f8681 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:16.253028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:16.254022 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:16.255036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:16.255519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:16.266631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:16.268097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:16.279679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1143/2289] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:16.810171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:16.811873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:16.832798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f40e1-192c-43d6-acf3-3fb056a5c53d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:16.855138 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:16.856038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:16.856311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:16.856774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] PATH_INFO: `/v3/projects/31272e2dc1f04186860587cb7f298810` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:16.858310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31272e2dc1f04186860587cb7f298810)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:16.861927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:16.938369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31272e2dc1f04186860587cb7f298810', 'request_id': 'req-9926df60-db0c-4d54-a853-917b5076103e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.947228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31272e2dc1f04186860587cb7f298810', 'request_id': 'req-9926df60-db0c-4d54-a853-917b5076103e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.958834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31272e2dc1f04186860587cb7f298810', 'request_id': 'req-9926df60-db0c-4d54-a853-917b5076103e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.975815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] The token cache is being invalidate because project 31272e2dc1f04186860587cb7f298810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:16.976164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.976869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:16.978884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1147/2290] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:16 2022] DELETE /identity/v3/projects/31272e2dc1f04186860587cb7f298810 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:16.982686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:16.997368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b372e52-6f40-4d97-94a1-a0271f0702de service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:17.011321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:17.085038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:17.085903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:17.086219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:17.086494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] PATH_INFO: `/v3/users/c735ad442131447e8a05e01d9c0ee23c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:17.088050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c735ad442131447e8a05e01d9c0ee23c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:17.093921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:17.162683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c735ad442131447e8a05e01d9c0ee23c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.175790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c735ad442131447e8a05e01d9c0ee23c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.177716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c735ad442131447e8a05e01d9c0ee23c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.177716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c735ad442131447e8a05e01d9c0ee23c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.204038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6b09be60-063e-4d93-9b80-d1f948e13688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c735ad442131447e8a05e01d9c0ee23c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.225189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1144/2291] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:16 2022] DELETE /identity/v3/users/c735ad442131447e8a05e01d9c0ee23c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:17.747046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:17.748575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:17.762393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926df60-db0c-4d54-a853-917b5076103e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:17.807037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:17.838537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:17.839558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:17.839941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:17.840436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] PATH_INFO: `/v3/projects/2b935b1581c3439fbf86f1c3d43dfda0` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:17.841850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b935b1581c3439fbf86f1c3d43dfda0)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:17.843990 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:17.930329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b935b1581c3439fbf86f1c3d43dfda0', 'request_id': 'req-7c34d72f-04b0-4d49-a131-3f71569bb191'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.936682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b935b1581c3439fbf86f1c3d43dfda0', 'request_id': 'req-7c34d72f-04b0-4d49-a131-3f71569bb191'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.948846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b935b1581c3439fbf86f1c3d43dfda0', 'request_id': 'req-7c34d72f-04b0-4d49-a131-3f71569bb191'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.962963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] The token cache is being invalidate because project 2b935b1581c3439fbf86f1c3d43dfda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:17.963256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.963992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7c34d72f-04b0-4d49-a131-3f71569bb191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:17.966052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1148/2292] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:17 2022] DELETE /identity/v3/projects/2b935b1581c3439fbf86f1c3d43dfda0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:17.971048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287ba7e-2560-468e-88b7-b2ad16a2ecb7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:17.971345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287ba7e-2560-468e-88b7-b2ad16a2ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:17.971627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287ba7e-2560-468e-88b7-b2ad16a2ecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:17.993779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2287ba7e-2560-468e-88b7-b2ad16a2ecb7 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:17.995154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2287ba7e-2560-468e-88b7-b2ad16a2ecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:18.095465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1145/2293] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:18.103664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c5bcd-e659-412e-968c-e1aad8155332 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.104016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c5bcd-e659-412e-968c-e1aad8155332 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.104346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c5bcd-e659-412e-968c-e1aad8155332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.131595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-007c5bcd-e659-412e-968c-e1aad8155332 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:18.133017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-007c5bcd-e659-412e-968c-e1aad8155332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:18.146634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1149/2294] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:18.150889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287ba7e-2560-468e-88b7-b2ad16a2ecb7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.163204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287ba7e-2560-468e-88b7-b2ad16a2ecb7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.168320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:18.168929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.169208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.170127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.170876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:18.171181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:18.172916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:18.187393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1146/2295] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:18.191900 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c5bcd-e659-412e-968c-e1aad8155332 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.206045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c5bcd-e659-412e-968c-e1aad8155332 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.215008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:18.215951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.216464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.216982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.218077 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:18.220296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:18.253432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1150/2296] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:18 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:18.258012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.268400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0765fe-c458-4da8-aba0-e3e880fb1fba admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.292969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:18.383151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:18.383583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.383913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.384193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.384953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:18.387814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:18.415847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1147/2297] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:18 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:18.420135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.455051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08f5fa-90ff-4f7a-8870-5ef639191888 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.462183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:18.462870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.463155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.463421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.464155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:18.466180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:18.486956 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1151/2298] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:18.487984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.504557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a031e7-9c47-4d04-a454-68ba62249018 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.515280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07664195-96c3-4719-9736-52e52fdc5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:18.516462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664195-96c3-4719-9736-52e52fdc5f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.517059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664195-96c3-4719-9736-52e52fdc5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.518222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07664195-96c3-4719-9736-52e52fdc5f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.519349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07664195-96c3-4719-9736-52e52fdc5f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:18.525373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07664195-96c3-4719-9736-52e52fdc5f7d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:18.547519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.548526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1148/2299] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:18.573558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ecc7d-0a87-49d9-9603-1fe461715b24 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.578812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:18.579804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.580144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.580474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] PATH_INFO: `/v3/projects/f6d26338e03844d7887f367f46402cc8/users/81770bac4ba04b0199717f3c37d864b4/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.605724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d26338e03844d7887f367f46402cc8, user_id=81770bac4ba04b0199717f3c37d864b4, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:18.609540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:18.630431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1152/2300] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:18 2022] PUT /identity/v3/projects/f6d26338e03844d7887f367f46402cc8/users/81770bac4ba04b0199717f3c37d864b4/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:18.640851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d88921-af2e-48de-9ec8-5f4bc86efd79 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.645737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d88921-af2e-48de-9ec8-5f4bc86efd79 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.646009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d88921-af2e-48de-9ec8-5f4bc86efd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.681290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c0d88921-af2e-48de-9ec8-5f4bc86efd79 None None] MFA Rules not processed for user `81770bac4ba04b0199717f3c37d864b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:18.682753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c0d88921-af2e-48de-9ec8-5f4bc86efd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:18.765640 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.766711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1149/2301] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:18.849276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580088b-c39c-4eda-b13f-c2001b9f2a7e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.854852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:18.855764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:18.856199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:18.856617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:18.857505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:18.859686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:18.881521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:18.917117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1153/2302] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:18 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:18.921543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d88921-af2e-48de-9ec8-5f4bc86efd79 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:18.934771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d88921-af2e-48de-9ec8-5f4bc86efd79 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:18.999567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:19.000406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:19.000759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:19.001100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:19.001800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:19.004583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:19.027637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1150/2303] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:18 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:19.031782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:19.048573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b23a3-2925-4ff0-9811-c832a0e97ff9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:19.059555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:19.060668 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:19.060970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:19.061250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:19.061979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:19.063651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:19.076462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1154/2304] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:19.080800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:19.091798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597f24-310e-4827-b9b5-ab3eea2a4098 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:19.096810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:19.098751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:19.098751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:19.098751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] PATH_INFO: `/v3/projects/869d6edd444a4670935e8005d86c4e25/users/f062fc6d7a2644138b977ff7da21692c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:19.118415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:19.123147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869d6edd444a4670935e8005d86c4e25, user_id=f062fc6d7a2644138b977ff7da21692c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:19.127343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:19.156576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:19.157810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1151/2305] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:19 2022] PUT /identity/v3/projects/869d6edd444a4670935e8005d86c4e25/users/f062fc6d7a2644138b977ff7da21692c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:19.167507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc5ce1-478a-4a5d-a55f-e12291e5703f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:19.229827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59d337-36a0-41f0-b952-ab86a8d90ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:19.231405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59d337-36a0-41f0-b952-ab86a8d90ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:19.231871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59d337-36a0-41f0-b952-ab86a8d90ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:19.232330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59d337-36a0-41f0-b952-ab86a8d90ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:19.233216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59d337-36a0-41f0-b952-ab86a8d90ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:19.234947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59d337-36a0-41f0-b952-ab86a8d90ef0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:19.249578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1155/2306] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:19.253100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:19.269446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248b6-572f-4d18-ae1b-3a8250bca2c6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:19.275826 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:19.277171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:19.277632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:19.278158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] PATH_INFO: `/v3/projects/869d6edd444a4670935e8005d86c4e25/users/f062fc6d7a2644138b977ff7da21692c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:19.280436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869d6edd444a4670935e8005d86c4e25, user_id=f062fc6d7a2644138b977ff7da21692c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:19.284102 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:19.297193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1152/2307] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:19 2022] PUT /identity/v3/projects/869d6edd444a4670935e8005d86c4e25/users/f062fc6d7a2644138b977ff7da21692c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:19.310469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34604-1e11-40b7-a630-b39d0b65c5f0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:19.310772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34604-1e11-40b7-a630-b39d0b65c5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:19.311055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34604-1e11-40b7-a630-b39d0b65c5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:19.350833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-eba34604-1e11-40b7-a630-b39d0b65c5f0 None None] MFA Rules not processed for user `f062fc6d7a2644138b977ff7da21692c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:19.353352 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-eba34604-1e11-40b7-a630-b39d0b65c5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:19.468463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1156/2308] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:19.469390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:19.471205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:19.578815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320f4e2-42e6-4c51-94d9-4fee5c3bddc7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:19.583984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:19.585390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:19.585766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:19.586256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:19.677116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:19.678783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:19.689867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1153/2309] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:21.396109 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece2dc-c7bd-4c60-918f-092b808f300e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:21.396685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece2dc-c7bd-4c60-918f-092b808f300e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:21.396863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ece2dc-c7bd-4c60-918f-092b808f300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:21.413565 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:21.414996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:21.434877 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d3d06-41e4-4212-9939-c5351fc1e1ce service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:21.441456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-16ece2dc-c7bd-4c60-918f-092b808f300e None None] MFA Rules not processed for user `50ca1fcef6174c7e812077408449f9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:21.442742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-16ece2dc-c7bd-4c60-918f-092b808f300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:21.447219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:21.452621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:21.452932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:21.453215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:21.484603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:21.487883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:21.511781 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1154/2310] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:21.549308 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:21.568203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:21.568203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:21.568439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1157/2311] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:21.659699 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7173fac-8e65-4ef7-b255-f8f199c07f98 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:21.691421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:21.698658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:21.698973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:21.699518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:21.703672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:21.705730 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:21.764912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1155/2312] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:21 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:21.769826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece2dc-c7bd-4c60-918f-092b808f300e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:21.811221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ece2dc-c7bd-4c60-918f-092b808f300e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:21.899434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:21.900543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:21.900886 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:21.901158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:21.902042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:21.903934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:21.932496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1158/2313] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:21 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:21.933988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:21.943840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:21.976902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc624c38-975f-45ff-92e0-ab10884fd69b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:21.982260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:21.983015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:21.983363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:21.984101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:21.984952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:21.987112 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:22.001310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1156/2314] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:22.005660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:22.017861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689934-ca97-4713-a8f4-f225022897f1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:22.023550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:22.024650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:22.024967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:22.025242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] PATH_INFO: `/v3/projects/2bc3f4cb48964a52a9836f078ef9fa1c/users/b70fbb5c19554746966274f7c3896429/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:22.045392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc3f4cb48964a52a9836f078ef9fa1c, user_id=b70fbb5c19554746966274f7c3896429, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:22.045392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:22.066479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1159/2315] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:22 2022] PUT /identity/v3/projects/2bc3f4cb48964a52a9836f078ef9fa1c/users/b70fbb5c19554746966274f7c3896429/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:22.071319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:22.084203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ee7cf-5853-4a1e-b02f-e32d383a9783 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:22.146619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:22.147316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:22.147600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:22.147874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:22.148611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:22.150316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:22.165361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1157/2316] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:22.166823 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:22.178803 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad85c-2fda-410e-ae85-07f8b6d7d0d2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:22.184019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bd82a-e382-4e06-a56e-b2e84f4bfd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:22.185287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd82a-e382-4e06-a56e-b2e84f4bfd4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:22.185287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd82a-e382-4e06-a56e-b2e84f4bfd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:22.185468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd82a-e382-4e06-a56e-b2e84f4bfd4a admin admin] PATH_INFO: `/v3/projects/2bc3f4cb48964a52a9836f078ef9fa1c/users/b70fbb5c19554746966274f7c3896429/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:22.187508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bd82a-e382-4e06-a56e-b2e84f4bfd4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc3f4cb48964a52a9836f078ef9fa1c, user_id=b70fbb5c19554746966274f7c3896429, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:22.190231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bd82a-e382-4e06-a56e-b2e84f4bfd4a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:22.203087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1160/2317] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:22 2022] PUT /identity/v3/projects/2bc3f4cb48964a52a9836f078ef9fa1c/users/b70fbb5c19554746966274f7c3896429/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:26.071793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:26.084089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a81bd-fcbb-48f0-bd9c-2f59a66d6a57 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:26.314898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:26.315941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:26.316444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:26.316822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] PATH_INFO: `/v3/users/81770bac4ba04b0199717f3c37d864b4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:26.320613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81770bac4ba04b0199717f3c37d864b4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:26.322698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:26.448100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81770bac4ba04b0199717f3c37d864b4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:26.462029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81770bac4ba04b0199717f3c37d864b4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:26.462791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81770bac4ba04b0199717f3c37d864b4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:26.465099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81770bac4ba04b0199717f3c37d864b4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:26.490100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81770bac4ba04b0199717f3c37d864b4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:26.529608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1158/2318] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:26 2022] DELETE /identity/v3/users/81770bac4ba04b0199717f3c37d864b4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:26.530872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:26.531381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:26.531472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:26.567507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:26.568809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:26.670098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1161/2319] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:26.674609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:26.676677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:26.691292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:26.774103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6e847-0b8e-4a92-9fd7-e7e7269e8286 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:26.795858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:26.796557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:26.796992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:26.797269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:26.834390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:26.840626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:26.869445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1159/2320] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:27.271208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:27.272834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:27.319498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee462f5-3081-4c6d-9ab6-dda1b0298b73 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:27.325440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:27.327016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:27.331416 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:27.332064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] PATH_INFO: `/v3/projects/f6d26338e03844d7887f367f46402cc8` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:27.336463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d26338e03844d7887f367f46402cc8)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:27.338951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:27.491183 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:27.502608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d26338e03844d7887f367f46402cc8', 'request_id': 'req-75f200d0-9db0-4326-9ab6-c3fff953f13b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.522875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d26338e03844d7887f367f46402cc8', 'request_id': 'req-75f200d0-9db0-4326-9ab6-c3fff953f13b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.549213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d26338e03844d7887f367f46402cc8', 'request_id': 'req-75f200d0-9db0-4326-9ab6-c3fff953f13b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.583551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] The token cache is being invalidate because project f6d26338e03844d7887f367f46402cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:27.584192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.589789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-75f200d0-9db0-4326-9ab6-c3fff953f13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.592074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1162/2321] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:27 2022] DELETE /identity/v3/projects/f6d26338e03844d7887f367f46402cc8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:27.599099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:27.633096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd658f9-e856-466a-9274-fb61646b2378 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:27.797115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:27.798120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:27.798573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:27.798989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] PATH_INFO: `/v3/users/f062fc6d7a2644138b977ff7da21692c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:27.805120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f062fc6d7a2644138b977ff7da21692c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:27.807355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:27.925543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f062fc6d7a2644138b977ff7da21692c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.942493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f062fc6d7a2644138b977ff7da21692c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.943262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f062fc6d7a2644138b977ff7da21692c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.944017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f062fc6d7a2644138b977ff7da21692c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:27.986088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f062fc6d7a2644138b977ff7da21692c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:28.016391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1160/2322] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:27 2022] DELETE /identity/v3/users/f062fc6d7a2644138b977ff7da21692c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:29.182062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:29.182617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:29.183314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:29.196151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:29.199670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:29.230141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] MFA Rules not processed for user `b70fbb5c19554746966274f7c3896429`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:29.231554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:29.251005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:29.307769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acead075-fcd6-4287-b6a7-7cec53df8c07 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:29.315076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:29.316535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:29.316974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:29.317433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] PATH_INFO: `/v3/projects/869d6edd444a4670935e8005d86c4e25` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:29.318705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869d6edd444a4670935e8005d86c4e25)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:29.320662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:29.349513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1163/2323] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:29.361941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:29.363614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:29.389644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869d6edd444a4670935e8005d86c4e25', 'request_id': 'req-9f7f8586-b288-4531-a7b0-90bc557d1125'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:29.400537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869d6edd444a4670935e8005d86c4e25', 'request_id': 'req-9f7f8586-b288-4531-a7b0-90bc557d1125'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:29.409132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869d6edd444a4670935e8005d86c4e25', 'request_id': 'req-9f7f8586-b288-4531-a7b0-90bc557d1125'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:29.432777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] The token cache is being invalidate because project 869d6edd444a4670935e8005d86c4e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:29.433515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:29.434161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9f7f8586-b288-4531-a7b0-90bc557d1125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:29.436458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1161/2324] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:29 2022] DELETE /identity/v3/projects/869d6edd444a4670935e8005d86c4e25 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:29.442790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be0ea1-4d08-4617-b5ca-3b8e2f8ec189 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:29.443256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be0ea1-4d08-4617-b5ca-3b8e2f8ec189 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:29.443636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be0ea1-4d08-4617-b5ca-3b8e2f8ec189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:29.461468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb953b1-a46d-4723-8474-7598bc94d0db None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:29.485683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-81be0ea1-4d08-4617-b5ca-3b8e2f8ec189 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:29.486963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-81be0ea1-4d08-4617-b5ca-3b8e2f8ec189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:29.575688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:29.576821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:29.577253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:29.577598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:29.583004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:29.647472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:29.695034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1162/2325] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:29.695034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537040b-8b7d-4e91-a9c8-4d5d5aaec11d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:29.695034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537040b-8b7d-4e91-a9c8-4d5d5aaec11d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:29.695823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537040b-8b7d-4e91-a9c8-4d5d5aaec11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:29.734631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0537040b-8b7d-4e91-a9c8-4d5d5aaec11d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:29.735883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0537040b-8b7d-4e91-a9c8-4d5d5aaec11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:29.747950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1163/2326] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:29.752148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537040b-8b7d-4e91-a9c8-4d5d5aaec11d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:29.759612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:29.762393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:29.764435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537040b-8b7d-4e91-a9c8-4d5d5aaec11d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:29.774031 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:29.774506 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:29.774788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:29.775055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:29.775786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:29.776389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:29.777971 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:29.779699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1164/2327] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:29.794266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1164/2328] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:29.802546 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:29.826280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930917-13ed-4020-8c19-1b6ebac27b5f service glance] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:29.833683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c34db4-6436-417e-8e49-01ad939cccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:29.834575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c34db4-6436-417e-8e49-01ad939cccaa admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:29.834841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c34db4-6436-417e-8e49-01ad939cccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:29.835298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c34db4-6436-417e-8e49-01ad939cccaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:29.836143 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c34db4-6436-417e-8e49-01ad939cccaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:29.838484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c34db4-6436-417e-8e49-01ad939cccaa admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:29.889331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1165/2329] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:29 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:29.893899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:29.938324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c2e75-8833-4390-9e32-0ce615b67ba7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:30.023625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:30.078929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:30.079684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.079956 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009cb99-ba65-4681-9e73-a2b3ad2e456b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.080070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.080335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009cb99-ba65-4681-9e73-a2b3ad2e456b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.080438 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.080525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009cb99-ba65-4681-9e73-a2b3ad2e456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.081014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:30.083264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:30.105711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b009cb99-ba65-4681-9e73-a2b3ad2e456b None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:30.107158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b009cb99-ba65-4681-9e73-a2b3ad2e456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:30.129194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1165/2330] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:29 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:30.130486 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:30.156409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23cb8c-50ac-4102-8281-dc01714a9ada admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:30.164263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:30.165683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.166194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.166566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.167428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:30.169589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:30.191744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1166/2331] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:30.196705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:30.208893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75744b-24fc-4888-8e35-c557b79217a8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:30.215098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:30.217021 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.217786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.218216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.219257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:30.221297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:30.229169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1166/2332] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:30.254680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1167/2333] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:30.259883 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009cb99-ba65-4681-9e73-a2b3ad2e456b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:30.290599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009cb99-ba65-4681-9e73-a2b3ad2e456b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:30.301649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:30.309317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:30.309669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2ffda-2a73-48dc-88eb-3ccfecaa83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:30.311871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ffda-2a73-48dc-88eb-3ccfecaa83e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.312894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ffda-2a73-48dc-88eb-3ccfecaa83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.313222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2ffda-2a73-48dc-88eb-3ccfecaa83e6 admin admin] PATH_INFO: `/v3/projects/4588f9b3ea314fdaa685790cb9ff4745/users/6cfde39344f9446198edf337383f070d/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.348865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2ffda-2a73-48dc-88eb-3ccfecaa83e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4588f9b3ea314fdaa685790cb9ff4745, user_id=6cfde39344f9446198edf337383f070d, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:30.351727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2ffda-2a73-48dc-88eb-3ccfecaa83e6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:30.394357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1167/2334] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:30 2022] PUT /identity/v3/projects/4588f9b3ea314fdaa685790cb9ff4745/users/6cfde39344f9446198edf337383f070d/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:30.405585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.405882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.406156 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.463100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] MFA Rules not processed for user `6cfde39344f9446198edf337383f070d`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:30.465152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:30.465937 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45f2e9-fa64-4558-9fc8-dba61d9252d0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:30.571909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:30.572873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.573263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.573642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.580856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1168/2335] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:30.593076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:30.595009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:30.623646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:30.651096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:30.656833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:30.658992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:30.670996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1168/2336] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:33:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:33:30.705184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144eb7b-aea7-425c-91a6-ae00ce1c4dd9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:30.712172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87bd6c-98e6-46f8-b07b-70d1654c060f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:30.713017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87bd6c-98e6-46f8-b07b-70d1654c060f service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.713251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87bd6c-98e6-46f8-b07b-70d1654c060f service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.713534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87bd6c-98e6-46f8-b07b-70d1654c060f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.733245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87bd6c-98e6-46f8-b07b-70d1654c060f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:30.734850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87bd6c-98e6-46f8-b07b-70d1654c060f service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:30.761069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1169/2337] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:30.777880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:30.860315 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f3740-01e5-4abe-a2cc-6589ba0cd7a0 service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:30.872362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:30.873658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.874911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.875383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] PATH_INFO: `/v3/users/6cfde39344f9446198edf337383f070d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.879291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfde39344f9446198edf337383f070d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:30.886424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:30.911245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895537f-549c-41f7-98cb-9ba4a8da6591 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:30.911957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895537f-549c-41f7-98cb-9ba4a8da6591 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:30.912357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895537f-549c-41f7-98cb-9ba4a8da6591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:30.933797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a895537f-549c-41f7-98cb-9ba4a8da6591 None None] MFA Rules not processed for user `586b4f81aeb84808901d6d9167594a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:30.935305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a895537f-549c-41f7-98cb-9ba4a8da6591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:31.016833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1170/2338] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:31.041446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfde39344f9446198edf337383f070d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:31.073740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfde39344f9446198edf337383f070d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:31.077205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfde39344f9446198edf337383f070d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:31.079483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfde39344f9446198edf337383f070d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:31.116120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfde39344f9446198edf337383f070d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:31.156217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1169/2339] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:30 2022] DELETE /identity/v3/users/6cfde39344f9446198edf337383f070d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:31.161748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:31.162037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:31.162324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:31.211373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:31.214248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:31.308814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1171/2340] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:31.326469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:31.328497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:31.489354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031c36f-52fe-47b1-b26f-1f0252ed28ed admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:31.495546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f21fb4-e6eb-4ff0-8554-04ac3b3f8d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:31.509309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f21fb4-e6eb-4ff0-8554-04ac3b3f8d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:31.509645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f21fb4-e6eb-4ff0-8554-04ac3b3f8d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:31.509864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f21fb4-e6eb-4ff0-8554-04ac3b3f8d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:31.533856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f21fb4-e6eb-4ff0-8554-04ac3b3f8d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:31.535614 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f21fb4-e6eb-4ff0-8554-04ac3b3f8d2b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:31.557659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1170/2341] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:32.133228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:32.135035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:32.172925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f9ae4-7e08-4f56-aade-ed1181ccb0c9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:32.196443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:32.198566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:32.198763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:32.200510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] PATH_INFO: `/v3/projects/4588f9b3ea314fdaa685790cb9ff4745` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:32.205106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4588f9b3ea314fdaa685790cb9ff4745)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:32.215948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:32.448909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4588f9b3ea314fdaa685790cb9ff4745', 'request_id': 'req-83202c20-a80e-47c9-aa84-e871ba5407ec'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:32.461498 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4588f9b3ea314fdaa685790cb9ff4745', 'request_id': 'req-83202c20-a80e-47c9-aa84-e871ba5407ec'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:32.476373 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:32.487035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4588f9b3ea314fdaa685790cb9ff4745', 'request_id': 'req-83202c20-a80e-47c9-aa84-e871ba5407ec'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:32.524095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] The token cache is being invalidate because project 4588f9b3ea314fdaa685790cb9ff4745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:32.524095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:32.526706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-83202c20-a80e-47c9-aa84-e871ba5407ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:32.529298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1172/2342] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:32 2022] DELETE /identity/v3/projects/4588f9b3ea314fdaa685790cb9ff4745 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:32.533993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821b44-8a71-45e3-9cc4-6955837d1947 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:32.534550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821b44-8a71-45e3-9cc4-6955837d1947 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:32.534550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1821b44-8a71-45e3-9cc4-6955837d1947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:32.556430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d1821b44-8a71-45e3-9cc4-6955837d1947 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:32.557902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d1821b44-8a71-45e3-9cc4-6955837d1947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:32.578356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:32.741558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1171/2343] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:32.743739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5277a6-c19d-4b72-a3da-4fec9e1dd5bd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:32.744193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5277a6-c19d-4b72-a3da-4fec9e1dd5bd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:32.744619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5277a6-c19d-4b72-a3da-4fec9e1dd5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:32.779783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6b5277a6-c19d-4b72-a3da-4fec9e1dd5bd None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:32.781127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6b5277a6-c19d-4b72-a3da-4fec9e1dd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:32.801565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1173/2344] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:32.805982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1821b44-8a71-45e3-9cc4-6955837d1947 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:32.816326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1821b44-8a71-45e3-9cc4-6955837d1947 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:32.830202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:32.832263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:32.834978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:32.837126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:32.838731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:32.841185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:32.847644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:32.885814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1172/2345] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:32.887799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5277a6-c19d-4b72-a3da-4fec9e1dd5bd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:32.901180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5277a6-c19d-4b72-a3da-4fec9e1dd5bd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:32.908814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:32.909933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:32.910568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:32.911228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:32.912896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:32.916103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:32.974487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1174/2346] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:32 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:32.982773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:33.004919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a70fc-cdd7-4c39-94b8-8c0f527c97c7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:33.085158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:33.085851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:33.086242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:33.086750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:33.087598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:33.089701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:33.119798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1173/2347] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:32 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:33.126000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:33.140239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01628a-28ca-4cc5-98e3-ec3d1b1697ab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:33.148494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:33.149677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:33.150256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:33.150574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:33.151713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:33.154118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:33.176939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:33.191755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1175/2348] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:33.194807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342e86e-18e6-4220-99fe-dc47585406eb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:33.209732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503511aa-a5ec-4e4d-af5c-6cf8106ca934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:33.210726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503511aa-a5ec-4e4d-af5c-6cf8106ca934 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:33.211006 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503511aa-a5ec-4e4d-af5c-6cf8106ca934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:33.211277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503511aa-a5ec-4e4d-af5c-6cf8106ca934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:33.212016 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503511aa-a5ec-4e4d-af5c-6cf8106ca934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:33.213900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503511aa-a5ec-4e4d-af5c-6cf8106ca934 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:33.234359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:33.243429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1174/2349] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:33.253469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe85e48-144e-4d0c-a3e1-f9508a1e3b93 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:33.263346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:33.265528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:33.265976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:33.266430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] PATH_INFO: `/v3/projects/000b6059b48844dcabbfaf5de1007651/users/3e724880189c4e63a761db832a72215f/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:33.294970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000b6059b48844dcabbfaf5de1007651, user_id=3e724880189c4e63a761db832a72215f, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:33.301988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:33.349238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:33.349560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:33.349857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:33.367770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1176/2350] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:33 2022] PUT /identity/v3/projects/000b6059b48844dcabbfaf5de1007651/users/3e724880189c4e63a761db832a72215f/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:33.427381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] MFA Rules not processed for user `3e724880189c4e63a761db832a72215f`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:33.433105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:33.599566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:33.602763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:33.659415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1175/2351] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:33.673119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:33.675372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:33.710844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:33.754188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc44e2-9af3-4f6d-89b9-8badbe11aa50 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:33.776012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:33.777164 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:33.777551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:33.777931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] PATH_INFO: `/v3/users/3483f3d97f5b46a58f95a99276fbf798` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:33.780940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3483f3d97f5b46a58f95a99276fbf798)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:33.784514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:33.880473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29bd1d-098f-441e-91bb-f5e9135e8fbd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:33.891068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:33.891861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:33.892133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:33.892408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:33.911319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3483f3d97f5b46a58f95a99276fbf798'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:33.921757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:33.922275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3483f3d97f5b46a58f95a99276fbf798'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:33.923224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:33.923907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3483f3d97f5b46a58f95a99276fbf798'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:33.925148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3483f3d97f5b46a58f95a99276fbf798'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:33.949161 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1176/2352] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:33.953765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3483f3d97f5b46a58f95a99276fbf798'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:33.989130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1177/2353] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:33 2022] DELETE /identity/v3/users/3483f3d97f5b46a58f95a99276fbf798 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:34.357929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:34.380150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdd5eb-d125-4fb9-a1ec-6ca54566b11a service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:34.584659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:34.585603 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:34.585881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:34.586163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] PATH_INFO: `/v3/projects/f2a662f6a5f9402b9f1cef45c9bf678f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:34.587433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2a662f6a5f9402b9f1cef45c9bf678f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:34.589391 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:34.718339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2a662f6a5f9402b9f1cef45c9bf678f', 'request_id': 'req-ead53295-e374-4318-8531-8bb69ec2e55a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:34.733475 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2a662f6a5f9402b9f1cef45c9bf678f', 'request_id': 'req-ead53295-e374-4318-8531-8bb69ec2e55a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:34.748496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2a662f6a5f9402b9f1cef45c9bf678f', 'request_id': 'req-ead53295-e374-4318-8531-8bb69ec2e55a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:34.779550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] The token cache is being invalidate because project f2a662f6a5f9402b9f1cef45c9bf678f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:34.780296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:34.781203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:34.783299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1177/2354] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:34 2022] DELETE /identity/v3/projects/f2a662f6a5f9402b9f1cef45c9bf678f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:34.787838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:34.790061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:34.808176 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:34.814052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ffeb0-c1cd-4977-8f9b-84ba8f26d9c8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:34.959066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:34.960001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:34.960280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:34.960554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] PATH_INFO: `/v3/users/8d318a43af44428aaf53cd5d4a920fdf` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:34.963014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d318a43af44428aaf53cd5d4a920fdf)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:34.965254 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:35.093827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d318a43af44428aaf53cd5d4a920fdf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:35.117771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d318a43af44428aaf53cd5d4a920fdf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:35.118577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d318a43af44428aaf53cd5d4a920fdf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:35.119840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d318a43af44428aaf53cd5d4a920fdf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:35.138429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-206d4f49-7a18-44dd-94ff-0ec2d572ba33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d318a43af44428aaf53cd5d4a920fdf'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:35.170860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1178/2355] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:34 2022] DELETE /identity/v3/users/8d318a43af44428aaf53cd5d4a920fdf => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:35.672914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:35.675213 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:35.701747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53295-e374-4318-8531-8bb69ec2e55a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:35.834876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:35.890245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:35.891168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:35.891451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:35.891728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] PATH_INFO: `/v3/projects/85c83d0d6a3143a29a274bf98ee50155` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:35.900357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c83d0d6a3143a29a274bf98ee50155)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:35.902487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:36.100553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c83d0d6a3143a29a274bf98ee50155', 'request_id': 'req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:36.121574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c83d0d6a3143a29a274bf98ee50155', 'request_id': 'req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:36.145986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c83d0d6a3143a29a274bf98ee50155', 'request_id': 'req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:36.185326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] The token cache is being invalidate because project 85c83d0d6a3143a29a274bf98ee50155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:36.186194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:36.188296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c10f04c3-89ba-41bc-ab5a-d5d9f84041ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:36.194134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1178/2356] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:35 2022] DELETE /identity/v3/projects/85c83d0d6a3143a29a274bf98ee50155 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:36.196119 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3bc5a-7376-4207-80e8-0c804ceafdb2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:36.197082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3bc5a-7376-4207-80e8-0c804ceafdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:36.197694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3bc5a-7376-4207-80e8-0c804ceafdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:36.284457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2bf3bc5a-7376-4207-80e8-0c804ceafdb2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:36.286275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2bf3bc5a-7376-4207-80e8-0c804ceafdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:36.468942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1179/2357] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:36.477104 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e016-a867-472a-8875-65ece595f225 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:36.477433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e016-a867-472a-8875-65ece595f225 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:36.477655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98e016-a867-472a-8875-65ece595f225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:36.508150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9b98e016-a867-472a-8875-65ece595f225 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:36.512084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9b98e016-a867-472a-8875-65ece595f225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:36.543703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1179/2358] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:36.544609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3bc5a-7376-4207-80e8-0c804ceafdb2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:36.562926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3bc5a-7376-4207-80e8-0c804ceafdb2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:36.572702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:36.573512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:36.573904 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:36.574242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:36.575067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:36.575431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:36.577189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:36.614959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1180/2359] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:33:36.620246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e016-a867-472a-8875-65ece595f225 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:36.638444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98e016-a867-472a-8875-65ece595f225 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:36.687233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:36.689407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:36.689837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:36.690703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:36.692619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:36.696952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:36.745707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1180/2360] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:36 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:36.746808 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:36.760478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c880b7-9f4a-46b6-a068-73e1c03e310c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:36.776876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:37.040444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:37.041616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:37.043177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:37.044664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:37.045677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:37.063329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:37.127095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1181/2361] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:36 2022] POST /identity/v3/users => generated 292 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:37.131881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:37.147936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa8d5e-f863-4d76-95cb-6152c93d366c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:37.166462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:37.167307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:37.167656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:37.167994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:37.168988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:37.173286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:37.195317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1181/2362] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:37.200075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:37.218670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ed643-58ee-4f23-9369-b9abdb3c0e08 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:37.231028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd173-2a92-4268-9163-77e0e8ff0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:37.233042 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd173-2a92-4268-9163-77e0e8ff0c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:37.235070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd173-2a92-4268-9163-77e0e8ff0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:37.235670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd173-2a92-4268-9163-77e0e8ff0c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:37.236683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fd173-2a92-4268-9163-77e0e8ff0c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:37.241664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fd173-2a92-4268-9163-77e0e8ff0c8e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:37.261245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1182/2363] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:33:37.265141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:37.279249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002a8bf-bb58-4837-ba68-74ef80cb503e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:37.292899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:37.293872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:37.294182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:37.295339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] PATH_INFO: `/v3/projects/3e2c6ba242484782a552d1f943f19a51/users/568ab37f578e4799b5d51ce0ec632452/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:37.340001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2c6ba242484782a552d1f943f19a51, user_id=568ab37f578e4799b5d51ce0ec632452, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:37.342769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:37.392931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1182/2364] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:37 2022] PUT /identity/v3/projects/3e2c6ba242484782a552d1f943f19a51/users/568ab37f578e4799b5d51ce0ec632452/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:37.394618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5f40-8ef0-4870-b50d-6d407bec6646 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:37.394922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5f40-8ef0-4870-b50d-6d407bec6646 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:37.395199 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e5f40-8ef0-4870-b50d-6d407bec6646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:37.449706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b06e5f40-8ef0-4870-b50d-6d407bec6646 None None] MFA Rules not processed for user `568ab37f578e4799b5d51ce0ec632452`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:37.450610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b06e5f40-8ef0-4870-b50d-6d407bec6646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:37.671262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1183/2365] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:33:37.685904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:37.689011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:37.834386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059ea7b-8e2e-4cfa-8cf4-2f05107d09cf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:37.840184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3ab8-849e-4d8a-b638-d44530c290c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:37.840982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3ab8-849e-4d8a-b638-d44530c290c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:37.841386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3ab8-849e-4d8a-b638-d44530c290c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:37.842085 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3ab8-849e-4d8a-b638-d44530c290c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:37.858607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b3ab8-849e-4d8a-b638-d44530c290c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:37.861493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b3ab8-849e-4d8a-b638-d44530c290c0 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:37.899591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1183/2366] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:37.927777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e5f40-8ef0-4870-b50d-6d407bec6646 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:38.054133 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e5f40-8ef0-4870-b50d-6d407bec6646 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:38.083968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:38.085059 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:38.085437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:38.085806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] PATH_INFO: `/v3/users/568ab37f578e4799b5d51ce0ec632452` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:38.087359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568ab37f578e4799b5d51ce0ec632452)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:38.089691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:38.152078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:38.233350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568ab37f578e4799b5d51ce0ec632452'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:38.245099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568ab37f578e4799b5d51ce0ec632452'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:38.246538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568ab37f578e4799b5d51ce0ec632452'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:38.247339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568ab37f578e4799b5d51ce0ec632452'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:38.266570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568ab37f578e4799b5d51ce0ec632452'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:38.325095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1184/2367] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:37 2022] DELETE /identity/v3/users/568ab37f578e4799b5d51ce0ec632452 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:38.329385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64350329-6e96-4c7d-855a-5ef828124be6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:38.330600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64350329-6e96-4c7d-855a-5ef828124be6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:38.331087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64350329-6e96-4c7d-855a-5ef828124be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:38.371300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-64350329-6e96-4c7d-855a-5ef828124be6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:38.373303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64350329-6e96-4c7d-855a-5ef828124be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:38.393992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:38.492590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1184/2368] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:38.523476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:38.524994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:38.652687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a99b4-60d7-4c21-8780-5cf0387feb53 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:38.665107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:38.665806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:38.666105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:38.666362 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:38.693219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:38.696315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:38.732399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1185/2369] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:38.925773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30a9a4-7c2c-495f-b389-615215373afb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:38.926070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30a9a4-7c2c-495f-b389-615215373afb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:38.926347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30a9a4-7c2c-495f-b389-615215373afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:38.961671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bc30a9a4-7c2c-495f-b389-615215373afb None None] MFA Rules not processed for user `f96e6bc11a9a4693955dea424e969e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:38.961903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc30a9a4-7c2c-495f-b389-615215373afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:39.054519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1185/2370] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:39.502275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:39.504964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:39.525047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97780805-0ecd-4f91-b068-c5c58ddb02da service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:39.544948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:39.545281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:39.545567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:39.545847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] PATH_INFO: `/v3/projects/3e2c6ba242484782a552d1f943f19a51` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:39.549484 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2c6ba242484782a552d1f943f19a51)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:39.555661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:39.648411 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2c6ba242484782a552d1f943f19a51', 'request_id': 'req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:39.668270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2c6ba242484782a552d1f943f19a51', 'request_id': 'req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:39.680882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2c6ba242484782a552d1f943f19a51', 'request_id': 'req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:39.696598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] The token cache is being invalidate because project 3e2c6ba242484782a552d1f943f19a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:39.697179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:39.697838 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6faa36ee-9aa3-4ac4-86f6-d5dfe5820b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:39.700762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1186/2371] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:39 2022] DELETE /identity/v3/projects/3e2c6ba242484782a552d1f943f19a51 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:39.705636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b298b-7cf8-4452-abad-60bd668a9eef None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:39.706631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b298b-7cf8-4452-abad-60bd668a9eef None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:39.707110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b298b-7cf8-4452-abad-60bd668a9eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:39.743165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ae4b298b-7cf8-4452-abad-60bd668a9eef None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:39.745073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ae4b298b-7cf8-4452-abad-60bd668a9eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:39.822455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1186/2372] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:39.830410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1aec3-d1d8-4bcd-92a2-9b397b84fa06 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:39.836475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1aec3-d1d8-4bcd-92a2-9b397b84fa06 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:39.838924 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1aec3-d1d8-4bcd-92a2-9b397b84fa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:39.872542 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-00b1aec3-d1d8-4bcd-92a2-9b397b84fa06 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:39.875082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-00b1aec3-d1d8-4bcd-92a2-9b397b84fa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:39.893870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1187/2373] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:39.900302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b298b-7cf8-4452-abad-60bd668a9eef None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:39.912370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b298b-7cf8-4452-abad-60bd668a9eef None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:39.918123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:39.918827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:39.919228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:39.919503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:39.920233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:33:39.921179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:39.922342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:39.938909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1187/2374] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:33:39.942797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1aec3-d1d8-4bcd-92a2-9b397b84fa06 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:39.954012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1aec3-d1d8-4bcd-92a2-9b397b84fa06 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:39.966776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:39.967694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:39.968055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:39.968393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:39.969215 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:39.971300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:39.986539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:40.007968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1188/2375] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:33:39 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:33:40.009230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:40.021965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3818d4-642f-4332-8c5d-439e97de63be admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:40.118773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:40.149286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:40.149901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:40.151052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:40.151342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:40.152351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:40.157283 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:40.226707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1188/2376] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:33:40 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:33:40.229595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:40.241620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f68055-7abf-425c-ad44-101c2d33cb40 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:40.247052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:40.247731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:40.248013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:40.248285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:40.249080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:40.250677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:40.263098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1189/2377] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:40.268531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:40.283206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804eca8-74f4-4abc-9baa-676066bee47b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:40.291266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5428c-4730-4308-99fe-d606e5946b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:40.295111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5428c-4730-4308-99fe-d606e5946b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:40.295589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5428c-4730-4308-99fe-d606e5946b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:40.296043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5428c-4730-4308-99fe-d606e5946b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:40.297514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5428c-4730-4308-99fe-d606e5946b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:40.300813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5428c-4730-4308-99fe-d606e5946b05 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:40.323964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:40.325367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1189/2378] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:33:40.344091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d58bb-c4fa-41fc-acb0-0338877745da admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:40.353202 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:40.354368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:40.355756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:40.356041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] PATH_INFO: `/v3/projects/1e7666915949497da16901be76a5297b/users/fd346edbd92c41eba5023af21d4e588c/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:40.395381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7666915949497da16901be76a5297b, user_id=fd346edbd92c41eba5023af21d4e588c, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:40.399167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:40.469416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acd58-cf87-40e7-a8a2-c5a77d41d1d9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:40.469955 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acd58-cf87-40e7-a8a2-c5a77d41d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:40.470377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30acd58-cf87-40e7-a8a2-c5a77d41d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:40.471882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1190/2379] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:33:40 2022] PUT /identity/v3/projects/1e7666915949497da16901be76a5297b/users/fd346edbd92c41eba5023af21d4e588c/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:33:40.533820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c30acd58-cf87-40e7-a8a2-c5a77d41d1d9 None None] MFA Rules not processed for user `fd346edbd92c41eba5023af21d4e588c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:40.537355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c30acd58-cf87-40e7-a8a2-c5a77d41d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:40.643193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1190/2380] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:40.656289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:40.666070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:40.760412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb340da1-6e82-4f71-9a84-c1db45719c2b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:40.774822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423167a-9478-4cbd-8dc2-49cc91846b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:40.776236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423167a-9478-4cbd-8dc2-49cc91846b5d service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:40.776678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423167a-9478-4cbd-8dc2-49cc91846b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:40.777149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423167a-9478-4cbd-8dc2-49cc91846b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:40.799342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423167a-9478-4cbd-8dc2-49cc91846b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:40.804831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423167a-9478-4cbd-8dc2-49cc91846b5d service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:40.829118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1191/2381] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:33:40.846196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30acd58-cf87-40e7-a8a2-c5a77d41d1d9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:40.953180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30acd58-cf87-40e7-a8a2-c5a77d41d1d9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:40.959078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:40.960123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:40.960409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:40.960683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] PATH_INFO: `/v3/users/fd346edbd92c41eba5023af21d4e588c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:40.962162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd346edbd92c41eba5023af21d4e588c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:40.964244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:41.024801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd346edbd92c41eba5023af21d4e588c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:41.034007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd346edbd92c41eba5023af21d4e588c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:41.035123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd346edbd92c41eba5023af21d4e588c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:41.035948 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd346edbd92c41eba5023af21d4e588c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:41.037661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:41.056910 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd346edbd92c41eba5023af21d4e588c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:41.075716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1191/2382] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:33:40 2022] DELETE /identity/v3/users/fd346edbd92c41eba5023af21d4e588c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:41.086432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:41.086432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:41.086432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:41.114899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:41.116785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:41.212853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1192/2383] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:41.221631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:41.224109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:41.306133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaf629-f60f-43bb-a6be-62880e512bc9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:41.310197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bbfbd-6594-48a4-ab06-f89c1e8dfb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:41.312801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbfbd-6594-48a4-ab06-f89c1e8dfb5d service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:41.312801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbfbd-6594-48a4-ab06-f89c1e8dfb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:41.312801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bbfbd-6594-48a4-ab06-f89c1e8dfb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:41.337484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bbfbd-6594-48a4-ab06-f89c1e8dfb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:41.339419 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bbfbd-6594-48a4-ab06-f89c1e8dfb5d service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:41.355160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1192/2384] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:33:41.881162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:41.883439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:41.902350 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5f023-fc80-4fab-8d65-50ca4e49f0ae None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:41.913294 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:41.914083 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:41.914332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:41.914729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] PATH_INFO: `/v3/projects/1e7666915949497da16901be76a5297b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:41.916422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7666915949497da16901be76a5297b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:41.918599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:42.028983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7666915949497da16901be76a5297b', 'request_id': 'req-edba5fde-0eb8-496e-a5b9-fb4680291201'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:42.045740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7666915949497da16901be76a5297b', 'request_id': 'req-edba5fde-0eb8-496e-a5b9-fb4680291201'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:42.048148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:42.076448 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7666915949497da16901be76a5297b', 'request_id': 'req-edba5fde-0eb8-496e-a5b9-fb4680291201'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:42.097992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] The token cache is being invalidate because project 1e7666915949497da16901be76a5297b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:33:42.098885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:42.100067 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:33:42.102684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1193/2385] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:33:41 2022] DELETE /identity/v3/projects/1e7666915949497da16901be76a5297b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:33:44.213542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3374a43-0d3b-4ecb-b3cf-a8320d37c1ac None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:44.214381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3374a43-0d3b-4ecb-b3cf-a8320d37c1ac None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:44.214980 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3374a43-0d3b-4ecb-b3cf-a8320d37c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:44.285807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a3374a43-0d3b-4ecb-b3cf-a8320d37c1ac None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:44.289147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a3374a43-0d3b-4ecb-b3cf-a8320d37c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:44.545929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1193/2386] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:33:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:44.561262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:44.562715 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:44.730152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5fde-0eb8-496e-a5b9-fb4680291201 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:44.744448 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b9ac4-e5bb-4c1b-8a98-994536246e04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:44.745321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9ac4-e5bb-4c1b-8a98-994536246e04 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:44.745609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9ac4-e5bb-4c1b-8a98-994536246e04 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:44.745888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b9ac4-e5bb-4c1b-8a98-994536246e04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:44.770707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b9ac4-e5bb-4c1b-8a98-994536246e04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:44.772651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b9ac4-e5bb-4c1b-8a98-994536246e04 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:44.801526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1194/2387] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:33:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:33:48.945167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed80ec-3925-4991-b4b3-1637f1b2b667 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:48.945800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed80ec-3925-4991-b4b3-1637f1b2b667 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:48.945800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed80ec-3925-4991-b4b3-1637f1b2b667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:48.965589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-45ed80ec-3925-4991-b4b3-1637f1b2b667 None None] MFA Rules not processed for user `50ca1fcef6174c7e812077408449f9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:48.966815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-45ed80ec-3925-4991-b4b3-1637f1b2b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:49.108341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1194/2388] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:33:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:54.794681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=3,keystone:SELECT=36 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:59.084478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=84,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:33:59.450658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471255-f911-431e-876e-f883927976ed None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:59.451166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471255-f911-431e-876e-f883927976ed None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:59.451389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471255-f911-431e-876e-f883927976ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:59.470354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0c471255-f911-431e-876e-f883927976ed None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:33:59.471778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0c471255-f911-431e-876e-f883927976ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:33:59.479481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1195/2389] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:33:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:33:59.493677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed80ec-3925-4991-b4b3-1637f1b2b667 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:33:59.508010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed80ec-3925-4991-b4b3-1637f1b2b667 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:33:59.514054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:33:59.515080 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:33:59.515521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:33:59.515807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:33:59.525327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:33:59.527421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:33:59.537091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1195/2390] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:34:01.653994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7d376-56e8-4706-a32d-a10380da2f31 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:01.654568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7d376-56e8-4706-a32d-a10380da2f31 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:01.654568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7d376-56e8-4706-a32d-a10380da2f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:01.673388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5ed7d376-56e8-4706-a32d-a10380da2f31 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:01.675173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5ed7d376-56e8-4706-a32d-a10380da2f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:01.682583 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1196/2391] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:34:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:01.698423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:01.710651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a68a8-a53d-4c94-8c38-ba226a331e3b service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:01.716577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc103-862a-4f51-957f-892565b27cf1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:01.717915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc103-862a-4f51-957f-892565b27cf1 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:01.718264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc103-862a-4f51-957f-892565b27cf1 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:01.718673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc103-862a-4f51-957f-892565b27cf1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:01.736484 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc103-862a-4f51-957f-892565b27cf1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:01.738691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc103-862a-4f51-957f-892565b27cf1 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:01.748855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1196/2392] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:34:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:34:11.667967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:11.744243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=12 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:12.014261 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f55d8c-9b5c-4482-a60e-79c215bd7e98 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.015160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f55d8c-9b5c-4482-a60e-79c215bd7e98 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.015603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f55d8c-9b5c-4482-a60e-79c215bd7e98 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.017323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1197/2393] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:34:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:34:12.029264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9b5d-d898-42ad-b63b-5c2744615903 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.029580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9b5d-d898-42ad-b63b-5c2744615903 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.029926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9b5d-d898-42ad-b63b-5c2744615903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.080767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-23ea9b5d-d898-42ad-b63b-5c2744615903 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:12.082032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-23ea9b5d-d898-42ad-b63b-5c2744615903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:12.276373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1197/2394] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:34:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:12.286305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f55d8c-9b5c-4482-a60e-79c215bd7e98 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:12.288105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-34f55d8c-9b5c-4482-a60e-79c215bd7e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:12.354145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f55d8c-9b5c-4482-a60e-79c215bd7e98 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:12.357880 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392296a5-9e88-4509-99dc-3cf9ac39307a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:12.358743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392296a5-9e88-4509-99dc-3cf9ac39307a service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.359219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392296a5-9e88-4509-99dc-3cf9ac39307a service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.359655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392296a5-9e88-4509-99dc-3cf9ac39307a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.371192 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392296a5-9e88-4509-99dc-3cf9ac39307a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:12.372908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392296a5-9e88-4509-99dc-3cf9ac39307a service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:12.385011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1198/2395] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:34:12.463428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493058cc-69e0-4f8a-92de-72c5fe489252 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.463810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493058cc-69e0-4f8a-92de-72c5fe489252 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.464157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493058cc-69e0-4f8a-92de-72c5fe489252 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.465698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1198/2396] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:34:12.471771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedcb07-c9c4-418f-b6f3-691ec8bafb42 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.472055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedcb07-c9c4-418f-b6f3-691ec8bafb42 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.472370 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cedcb07-c9c4-418f-b6f3-691ec8bafb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.512789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6cedcb07-c9c4-418f-b6f3-691ec8bafb42 None None] MFA Rules not processed for user `795571c4c2cc4f969ce487c0ec6dfbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:12.514068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6cedcb07-c9c4-418f-b6f3-691ec8bafb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:12.585730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1199/2397] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:34:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:12.598075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493058cc-69e0-4f8a-92de-72c5fe489252 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:12.600084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-493058cc-69e0-4f8a-92de-72c5fe489252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:12.615058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493058cc-69e0-4f8a-92de-72c5fe489252 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:12.618673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1607a9-1ba9-4b3d-b8f3-2678fa6c3b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:12.619403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1607a9-1ba9-4b3d-b8f3-2678fa6c3b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.619829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1607a9-1ba9-4b3d-b8f3-2678fa6c3b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.620197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1607a9-1ba9-4b3d-b8f3-2678fa6c3b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.628278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1607a9-1ba9-4b3d-b8f3-2678fa6c3b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:12.629854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1607a9-1ba9-4b3d-b8f3-2678fa6c3b74 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:12.638841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1199/2398] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:34:12.733549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b47bc-c7d5-45ce-8674-aa8cbac84171 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.734085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b47bc-c7d5-45ce-8674-aa8cbac84171 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.734180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b47bc-c7d5-45ce-8674-aa8cbac84171 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.735642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1200/2399] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:34:12.741167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338465-9f25-4fab-b140-3b811e7072d3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.741460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338465-9f25-4fab-b140-3b811e7072d3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.741777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338465-9f25-4fab-b140-3b811e7072d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.763145 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-52338465-9f25-4fab-b140-3b811e7072d3 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:12.764458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-52338465-9f25-4fab-b140-3b811e7072d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:12.778003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1200/2400] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:34:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:12.789037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b47bc-c7d5-45ce-8674-aa8cbac84171 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:12.802663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b47bc-c7d5-45ce-8674-aa8cbac84171 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:12.806169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:12.806932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:12.807318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:12.807693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:12.831153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:12.832761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:12.857131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1201/2401] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:34:15.971228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:15.972400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:15.972876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:15.995049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:15.996543 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:16.010493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1201/2402] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:16.025848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:16.039186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ecb5f-1409-45dc-a157-7ac5292a5662 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:16.047517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dac757-412e-42b1-85bb-b472fa360b1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:16.048544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dac757-412e-42b1-85bb-b472fa360b1b service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:16.049506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dac757-412e-42b1-85bb-b472fa360b1b service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:16.049938 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dac757-412e-42b1-85bb-b472fa360b1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:16.071709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dac757-412e-42b1-85bb-b472fa360b1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:16.073729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dac757-412e-42b1-85bb-b472fa360b1b service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:16.087472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1202/2403] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:34:19.327588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:19.329642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:19.449220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:19.490700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbdb37-e3db-4be5-adf5-d2100d355cfe None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:19.497350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:19.498306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:19.498585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:19.498851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] PATH_INFO: `/v3/users/3e724880189c4e63a761db832a72215f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:19.500066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e724880189c4e63a761db832a72215f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:19.502068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:19.581183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e724880189c4e63a761db832a72215f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:19.582018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eb83f-7b80-4da8-9351-885ffd546f84 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:19.582477 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eb83f-7b80-4da8-9351-885ffd546f84 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:19.582655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3eb83f-7b80-4da8-9351-885ffd546f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:19.599575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e724880189c4e63a761db832a72215f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:19.600331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e724880189c4e63a761db832a72215f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:19.600986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e724880189c4e63a761db832a72215f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:19.616634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e724880189c4e63a761db832a72215f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:19.626819 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5f3eb83f-7b80-4da8-9351-885ffd546f84 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:19.629536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5f3eb83f-7b80-4da8-9351-885ffd546f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:19.643104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1203/2405] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jun 23 11:34:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:34:19.644528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1202/2405] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:34:19 2022] DELETE /identity/v3/users/3e724880189c4e63a761db832a72215f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:34:19.651159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:19.651526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:19.651879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:19.661593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:19.663038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:19.699190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:19.700952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:19.745474 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96f928-d96b-463c-9332-4e97dc565e5a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:19.747480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:19.754203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:19.756379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:19.756379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:19.756379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:19.767889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1204/2406] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:19.781339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:19.782812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:19.817626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:19.819240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:19.832750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1203/2407] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:34:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:34:19.856894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fe004-b5ee-4cda-a4fe-3aaf5e996b34 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:19.861122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa4ba-7ce8-4f80-9496-512ad365dc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:19.862161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa4ba-7ce8-4f80-9496-512ad365dc1e service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:19.862519 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa4ba-7ce8-4f80-9496-512ad365dc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:19.862796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa4ba-7ce8-4f80-9496-512ad365dc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:19.877850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa4ba-7ce8-4f80-9496-512ad365dc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:19.879388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa4ba-7ce8-4f80-9496-512ad365dc1e service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:19.911286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1205/2408] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:34:20.284762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:20.287153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:20.309560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dcd1b9-419a-423d-af20-2675d7a4f83a service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:20.316045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:20.317329 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.317536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.317877 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] PATH_INFO: `/v3/projects/000b6059b48844dcabbfaf5de1007651` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:20.319224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000b6059b48844dcabbfaf5de1007651)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:20.321560 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:20.329230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:20.391060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000b6059b48844dcabbfaf5de1007651', 'request_id': 'req-a8bda4db-608d-4b49-9ab9-eab3d14664c8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:20.398183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000b6059b48844dcabbfaf5de1007651', 'request_id': 'req-a8bda4db-608d-4b49-9ab9-eab3d14664c8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:20.404398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000b6059b48844dcabbfaf5de1007651', 'request_id': 'req-a8bda4db-608d-4b49-9ab9-eab3d14664c8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:20.421949 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] The token cache is being invalidate because project 000b6059b48844dcabbfaf5de1007651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:34:20.422581 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:20.423965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8bda4db-608d-4b49-9ab9-eab3d14664c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:20.425788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1204/2409] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:34:20 2022] DELETE /identity/v3/projects/000b6059b48844dcabbfaf5de1007651 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:34:20.433200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5348-a6d5-46be-bf83-63cf2d891b83 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.433496 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5348-a6d5-46be-bf83-63cf2d891b83 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.433767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5348-a6d5-46be-bf83-63cf2d891b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:20.509052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cb8e5348-a6d5-46be-bf83-63cf2d891b83 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:20.510711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cb8e5348-a6d5-46be-bf83-63cf2d891b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:20.661500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1206/2410] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:20.663352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109c84-003e-471a-91e0-45ddd311b968 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.663646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109c84-003e-471a-91e0-45ddd311b968 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.663927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54109c84-003e-471a-91e0-45ddd311b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:20.704561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-54109c84-003e-471a-91e0-45ddd311b968 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:20.705902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-54109c84-003e-471a-91e0-45ddd311b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:20.715810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1205/2411] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:34:20.720468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5348-a6d5-46be-bf83-63cf2d891b83 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:20.730722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5348-a6d5-46be-bf83-63cf2d891b83 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:20.741184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:20.743188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.743748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.744040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:20.745678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:34:20.746349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:20.748376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:20.765933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1207/2412] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:34:20.767302 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109c84-003e-471a-91e0-45ddd311b968 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:20.778227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54109c84-003e-471a-91e0-45ddd311b968 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:20.783403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:20.784092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.784395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.784640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:20.785430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:20.787353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:20.823469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1206/2413] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:34:20 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:34:20.827721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:20.839388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a1e5-35c5-4e65-8a81-e6d3ce3aa28a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:20.901127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:20.911784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:20.912791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.913242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.913666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:20.914509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:20.916591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:20.940009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1208/2414] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:34:20 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:34:20.944425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:20.956819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee6f3-e1a3-4b76-b5cc-312c6cb11d6a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:20.962083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:20.962770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.963053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.963328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:20.964068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:20.965720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:20.977340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1207/2415] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:34:20.982267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:20.993052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87327ca2-b6d0-4289-8423-6ba7980d3131 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:20.997897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb380776-15e7-4101-8d87-adb69d34a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:20.998584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380776-15e7-4101-8d87-adb69d34a32f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:20.998872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380776-15e7-4101-8d87-adb69d34a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:20.999141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb380776-15e7-4101-8d87-adb69d34a32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:21.000173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380776-15e7-4101-8d87-adb69d34a32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:21.001814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb380776-15e7-4101-8d87-adb69d34a32f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:21.014584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1209/2416] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:34:21.018769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:21.029364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8e9d5-fbb2-49e5-b694-8eb960957803 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:21.034591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:21.035493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:21.035790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:21.036042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] PATH_INFO: `/v3/projects/02a7012dddd8451883abc31f5c4874c1/users/585bce42921346c4b26ae312b888518f/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:21.053012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a7012dddd8451883abc31f5c4874c1, user_id=585bce42921346c4b26ae312b888518f, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:21.055759 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:21.071361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1208/2417] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:34:21 2022] PUT /identity/v3/projects/02a7012dddd8451883abc31f5c4874c1/users/585bce42921346c4b26ae312b888518f/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:34:21.082424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:21.082893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:21.083267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:21.122045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] MFA Rules not processed for user `585bce42921346c4b26ae312b888518f`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:21.123595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:21.224240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1210/2418] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:34:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:34:21.236222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:21.239536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:21.309639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc31f99a-15f2-4e60-830e-8fad737c3ed7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:21.313398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:21.314094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:21.314345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:21.315012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:21.324378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:21.325857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:21.334928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1209/2419] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:34:22.274565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:22.276670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:22.380834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b280c6-7bf5-421d-b9da-ba1e7837d25f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:22.387707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:22.389290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:22.389867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:22.390439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] PATH_INFO: `/v3/users/586b4f81aeb84808901d6d9167594a1e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:22.392160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586b4f81aeb84808901d6d9167594a1e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:22.395386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:22.472940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586b4f81aeb84808901d6d9167594a1e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.493968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586b4f81aeb84808901d6d9167594a1e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.495472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586b4f81aeb84808901d6d9167594a1e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.496454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586b4f81aeb84808901d6d9167594a1e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.502280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:22.521584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586b4f81aeb84808901d6d9167594a1e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.542581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1211/2420] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:34:22 2022] DELETE /identity/v3/users/586b4f81aeb84808901d6d9167594a1e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:34:22.738734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:22.749943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd128e-fafa-423a-ae29-c57f1eea9dc7 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:22.790153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:22.823451 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:22.824338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:22.824627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:22.824935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] PATH_INFO: `/v3/projects/22a2f33b69e1494396f3c2912e31b3fa` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:22.826148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a2f33b69e1494396f3c2912e31b3fa)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:22.828066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:22.886365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a2f33b69e1494396f3c2912e31b3fa', 'request_id': 'req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.895458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a2f33b69e1494396f3c2912e31b3fa', 'request_id': 'req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.902921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a2f33b69e1494396f3c2912e31b3fa', 'request_id': 'req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.927680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] The token cache is being invalidate because project 22a2f33b69e1494396f3c2912e31b3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:34:22.928054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.928792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8c8f70fd-5f62-4609-9b7d-5b2ea6d9dede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:22.930658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1210/2421] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:34:22 2022] DELETE /identity/v3/projects/22a2f33b69e1494396f3c2912e31b3fa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:34:26.631834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:26.634779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:26.649456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fad563-b946-4122-9776-74929308f3e2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:26.710543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:26.711447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:26.711738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:26.712005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] PATH_INFO: `/v3/users/585bce42921346c4b26ae312b888518f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:26.713375 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=585bce42921346c4b26ae312b888518f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:26.715341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:26.784597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585bce42921346c4b26ae312b888518f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:26.793877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585bce42921346c4b26ae312b888518f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:26.794682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585bce42921346c4b26ae312b888518f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:26.795342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585bce42921346c4b26ae312b888518f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:26.817278 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585bce42921346c4b26ae312b888518f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:26.835448 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1212/2422] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:34:26 2022] DELETE /identity/v3/users/585bce42921346c4b26ae312b888518f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:34:26.839973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:26.840521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:26.840521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:26.859450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:26.860810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:26.926035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1211/2423] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:26.935817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:26.937435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:27.000309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438e635-e2c3-4dc1-9cb1-e1af8fd31ceb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:27.006925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:27.007590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:27.007874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:27.008147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:27.019064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:27.020628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:27.025773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:27.031271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1213/2424] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:34:27.371489 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:27.373032 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:27.389923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb38b3a-8f03-46a7-830f-c4ac7b50caf4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:27.395650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:27.396561 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:27.396978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:27.397111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] PATH_INFO: `/v3/projects/02a7012dddd8451883abc31f5c4874c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:27.398468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a7012dddd8451883abc31f5c4874c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:27.400326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:27.449716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a7012dddd8451883abc31f5c4874c1', 'request_id': 'req-ebb95f76-9b68-4491-8a6f-79142656a598'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:27.456424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a7012dddd8451883abc31f5c4874c1', 'request_id': 'req-ebb95f76-9b68-4491-8a6f-79142656a598'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:27.458519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:27.462970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a7012dddd8451883abc31f5c4874c1', 'request_id': 'req-ebb95f76-9b68-4491-8a6f-79142656a598'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:27.476742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] The token cache is being invalidate because project 02a7012dddd8451883abc31f5c4874c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:34:27.477035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:27.477670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ebb95f76-9b68-4491-8a6f-79142656a598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:34:27.479250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1212/2425] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:34:27 2022] DELETE /identity/v3/projects/02a7012dddd8451883abc31f5c4874c1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:34:32.959791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:32.961366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:32.972981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a4cf-7971-482f-9725-95d8b207072a service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:33.024570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:33.025267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:33.025543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:33.025811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:33.027997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:33.095864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:33.097368 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:33.107728 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1214/2426] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:34:34.037872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:34.038611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:34.038611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:34.058178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:34:34.059534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:34.133039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1213/2427] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jun 23 11:34:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:34:34.155365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:34.157001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:34.228537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f11b-8a57-4c55-97aa-34a4902ceb67 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:34.233773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2948f-2b9f-42b6-92aa-ec37a7742445 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:34.234431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2948f-2b9f-42b6-92aa-ec37a7742445 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:34.234709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2948f-2b9f-42b6-92aa-ec37a7742445 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:34.234985 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2948f-2b9f-42b6-92aa-ec37a7742445 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:34.243533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2948f-2b9f-42b6-92aa-ec37a7742445 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:34.245178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2948f-2b9f-42b6-92aa-ec37a7742445 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:34.253344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1215/2428] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:34:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:34:44.126079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=32,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:44.250286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=82 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:34:45.379731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:34:45.381974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:45.489097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc580cc-bdbc-479a-9889-48cfdfc4117a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:34:45.496448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47664806-a849-4731-88f8-dcdbe03ab9c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:34:45.497652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664806-a849-4731-88f8-dcdbe03ab9c8 service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:34:45.498118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664806-a849-4731-88f8-dcdbe03ab9c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:34:45.498402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664806-a849-4731-88f8-dcdbe03ab9c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:34:45.501467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-47664806-a849-4731-88f8-dcdbe03ab9c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:34:45.513930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47664806-a849-4731-88f8-dcdbe03ab9c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:34:45.515518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47664806-a849-4731-88f8-dcdbe03ab9c8 service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:34:45.525953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1214/2429] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:34:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:34:55.521732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=41 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:35:06.023783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb3997-c045-4217-9100-b3917208bc35 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:35:06.024299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb3997-c045-4217-9100-b3917208bc35 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:35:06.024402 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb3997-c045-4217-9100-b3917208bc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:35:06.042062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-44bb3997-c045-4217-9100-b3917208bc35 None None] MFA Rules not processed for user `f96e6bc11a9a4693955dea424e969e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:35:06.043301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-44bb3997-c045-4217-9100-b3917208bc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:35:06.106874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1216/2430] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:35:16.097151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=25 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:35:23.194853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e886-002c-49ca-9c13-e2c8d639f617 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:35:23.195716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e886-002c-49ca-9c13-e2c8d639f617 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:35:23.195716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e886-002c-49ca-9c13-e2c8d639f617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:35:23.218363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3132e886-002c-49ca-9c13-e2c8d639f617 None None] MFA Rules not processed for user `5a17f3ec8f4d43049b61688a0578cd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:35:23.219575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3132e886-002c-49ca-9c13-e2c8d639f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:35:23.275756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1215/2431] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:35:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:35:33.268537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=25 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:35:46.166539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e8071-23bf-4489-a2b3-9442d7da6c53 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:35:46.167046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e8071-23bf-4489-a2b3-9442d7da6c53 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:35:46.167181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e8071-23bf-4489-a2b3-9442d7da6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:35:46.185641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-231e8071-23bf-4489-a2b3-9442d7da6c53 None None] MFA Rules not processed for user `73c9e36a6c5f4bc8962ef86d39c496cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:35:46.186834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-231e8071-23bf-4489-a2b3-9442d7da6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:35:46.242100 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1217/2432] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:35:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:35:56.235227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=25 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:08.663932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:08.664387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:08.664479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:08.713649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:08.714879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:08.734158 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1216/2433] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jun 23 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:08.787799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e8071-23bf-4489-a2b3-9442d7da6c53 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:08.811188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e8071-23bf-4489-a2b3-9442d7da6c53 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:08.816391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:08.817104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:08.817387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:08.817662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:08.826514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:08.828052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:08.836603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1218/2434] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:36:12.361378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:12.363035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:12.470389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef54f9-5ec6-48d6-87cd-fc42bb3bb848 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:12.475626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:12.476621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:12.477001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:12.477350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] PATH_INFO: `/v3/users/f96e6bc11a9a4693955dea424e969e74` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:12.478684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96e6bc11a9a4693955dea424e969e74)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:12.480693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:12.533640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96e6bc11a9a4693955dea424e969e74'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:12.540684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96e6bc11a9a4693955dea424e969e74'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:12.541445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96e6bc11a9a4693955dea424e969e74'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:12.542072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96e6bc11a9a4693955dea424e969e74'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:12.555084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ed86d2d-9e44-4193-895d-feee879a6314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96e6bc11a9a4693955dea424e969e74'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:12.569902 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1217/2435] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:12 2022] DELETE /identity/v3/users/f96e6bc11a9a4693955dea424e969e74 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:12.884182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:12.896026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075d1a4-bb43-4cbd-9696-ac0b12be8d80 service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:12.975588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:12.976680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:12.977190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:12.977482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] PATH_INFO: `/v3/projects/22bc5a3943fb49589ae88a56c955a8cd` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:12.978686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bc5a3943fb49589ae88a56c955a8cd)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:12.980609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.044329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bc5a3943fb49589ae88a56c955a8cd', 'request_id': 'req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:13.063809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bc5a3943fb49589ae88a56c955a8cd', 'request_id': 'req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:13.074875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bc5a3943fb49589ae88a56c955a8cd', 'request_id': 'req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:13.087872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] The token cache is being invalidate because project 22bc5a3943fb49589ae88a56c955a8cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:13.088124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:13.088925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8f3c6e22-42c0-4bc7-a5e3-f1c10b7dd413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:13.094799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1219/2436] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:12 2022] DELETE /identity/v3/projects/22bc5a3943fb49589ae88a56c955a8cd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:13.096754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61afab-9017-4ab6-881a-b0e177323afa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.097267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61afab-9017-4ab6-881a-b0e177323afa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.097844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61afab-9017-4ab6-881a-b0e177323afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.125762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-be61afab-9017-4ab6-881a-b0e177323afa None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:13.127746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-be61afab-9017-4ab6-881a-b0e177323afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:13.161579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:13.191053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1218/2437] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:13.199336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bac9d-882b-44e2-baca-dab3cde2b2e6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.199683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bac9d-882b-44e2-baca-dab3cde2b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.199931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bac9d-882b-44e2-baca-dab3cde2b2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.219478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-114bac9d-882b-44e2-baca-dab3cde2b2e6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:13.220747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-114bac9d-882b-44e2-baca-dab3cde2b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:13.235209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1220/2438] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:13.236737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61afab-9017-4ab6-881a-b0e177323afa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.247003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61afab-9017-4ab6-881a-b0e177323afa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.252092 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.252800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.253095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.253567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.254805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:36:13.255118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.257384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.271162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1219/2439] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:36:13.275333 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bac9d-882b-44e2-baca-dab3cde2b2e6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.286552 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bac9d-882b-44e2-baca-dab3cde2b2e6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.292221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.292927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.293213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.293481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.294171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.297064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.326963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1221/2440] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:36:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:13.330993 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.341109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cc3e9-eba9-4666-a5e8-7af4a4f40d89 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.404628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.405915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.406414 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.406691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.407389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.409335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.436382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1220/2441] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:36:13 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:13.437922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.449616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8024-f0e1-45d8-8a19-7399cc009dbd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.454646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.455361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.455630 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.455897 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.456615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.458306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.470394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1222/2442] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:13.474801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.486917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ea46f-4b75-4cc0-8c0e-0f7578d251d0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.494187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8096fa-57b7-4ec1-8150-058368a5b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.495204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8096fa-57b7-4ec1-8150-058368a5b7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.495495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8096fa-57b7-4ec1-8150-058368a5b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.495772 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8096fa-57b7-4ec1-8150-058368a5b7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.496505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8096fa-57b7-4ec1-8150-058368a5b7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.498155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8096fa-57b7-4ec1-8150-058368a5b7e7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.510433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1221/2443] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:13.514680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.529212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66f99-5e93-4803-9bc9-bf8e2881b361 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.534986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.535907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.536190 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.536464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] PATH_INFO: `/v3/projects/2c9906457fac43cbbe86e81a78b712a3/users/5eb3f51d356f4cea97ccfad93accff4f/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.553141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9906457fac43cbbe86e81a78b712a3, user_id=5eb3f51d356f4cea97ccfad93accff4f, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.555840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.577795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1223/2444] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:13 2022] PUT /identity/v3/projects/2c9906457fac43cbbe86e81a78b712a3/users/5eb3f51d356f4cea97ccfad93accff4f/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:13.588116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8f34f-49f7-49cc-8e50-b83003e5ee03 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.588404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8f34f-49f7-49cc-8e50-b83003e5ee03 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.588663 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8f34f-49f7-49cc-8e50-b83003e5ee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.618845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9be8f34f-49f7-49cc-8e50-b83003e5ee03 None None] MFA Rules not processed for user `5eb3f51d356f4cea97ccfad93accff4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:13.621119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9be8f34f-49f7-49cc-8e50-b83003e5ee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:13.700943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1222/2445] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:13.706513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.713145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:13.788363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55417179-2075-47a4-963c-f7728c57d846 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.793500 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.794279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.795243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.795619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.796541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.798906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.835265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1224/2446] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:36:13 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:13.839373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8f34f-49f7-49cc-8e50-b83003e5ee03 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.854267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8f34f-49f7-49cc-8e50-b83003e5ee03 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.897386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:13.940924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.941129 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.942028 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.942317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.943052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.945413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:13.971212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1223/2447] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:36:13 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:36:13.975391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:13.987470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384bb2a-e88d-4d44-9874-6143da8705ba admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:13.992473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:13.993223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:13.993511 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:13.993785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:13.994524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:13.996158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:14.009760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1225/2448] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:36:14.015291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:14.026856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33eda7-89d1-44e5-a8af-376a3665b036 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:14.032908 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:14.033831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:14.034183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:14.034521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] PATH_INFO: `/v3/projects/94d66ba60b084c349d82969da2bfd656/users/dd4a8b891a034a719ac3e46a03052e3c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:14.057090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d66ba60b084c349d82969da2bfd656, user_id=dd4a8b891a034a719ac3e46a03052e3c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:14.059764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:14.077147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1224/2449] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:14 2022] PUT /identity/v3/projects/94d66ba60b084c349d82969da2bfd656/users/dd4a8b891a034a719ac3e46a03052e3c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:14.081425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:14.096685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457c26-795f-48bb-9538-206ed172b794 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:14.159343 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248e0e8-f12b-40c8-bb31-06bf2e33db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:14.160026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248e0e8-f12b-40c8-bb31-06bf2e33db55 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:14.160305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248e0e8-f12b-40c8-bb31-06bf2e33db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:14.160591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248e0e8-f12b-40c8-bb31-06bf2e33db55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:14.161353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248e0e8-f12b-40c8-bb31-06bf2e33db55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:14.162997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248e0e8-f12b-40c8-bb31-06bf2e33db55 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:14.175677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1226/2450] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:36:14.179795 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:14.191597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406db8d8-d1f2-474b-b42d-d7758d06f815 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:14.197872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:14.198785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:14.199063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:14.199333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] PATH_INFO: `/v3/projects/94d66ba60b084c349d82969da2bfd656/users/dd4a8b891a034a719ac3e46a03052e3c/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:14.201462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d66ba60b084c349d82969da2bfd656, user_id=dd4a8b891a034a719ac3e46a03052e3c, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:14.204210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:14.219375 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1225/2451] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:14 2022] PUT /identity/v3/projects/94d66ba60b084c349d82969da2bfd656/users/dd4a8b891a034a719ac3e46a03052e3c/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:14.230247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808427a-29bd-4382-a29d-b2afbbd40699 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:14.230540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808427a-29bd-4382-a29d-b2afbbd40699 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:14.230830 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808427a-29bd-4382-a29d-b2afbbd40699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:14.259318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d808427a-29bd-4382-a29d-b2afbbd40699 None None] MFA Rules not processed for user `dd4a8b891a034a719ac3e46a03052e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:14.260627 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d808427a-29bd-4382-a29d-b2afbbd40699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:14.337776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:14.346637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1227/2452] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:14.353788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:14.355547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:14.443616 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55375047-2dca-482d-990c-056b2977d00c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:14.447751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:14.448476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:14.448793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:14.449295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:14.460425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:14.461939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:14.473684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1226/2453] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:14.554715 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808427a-29bd-4382-a29d-b2afbbd40699 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:14.565495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808427a-29bd-4382-a29d-b2afbbd40699 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:14.570269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:14.570916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:14.571334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:14.571611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:14.639314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:14.641035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:14.651015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1228/2454] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:16.212779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:16.212779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:16.301744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46442803-8f9f-4fab-89b8-77182e98fbbe service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:16.306719 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:16.308476 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:16.308796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:16.309086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] PATH_INFO: `/v3/users/50ca1fcef6174c7e812077408449f9d0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:16.310305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ca1fcef6174c7e812077408449f9d0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:16.313193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:16.326000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:16.363024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ca1fcef6174c7e812077408449f9d0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.370166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ca1fcef6174c7e812077408449f9d0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.370862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ca1fcef6174c7e812077408449f9d0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.371507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ca1fcef6174c7e812077408449f9d0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.383703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ca1fcef6174c7e812077408449f9d0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.397629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1227/2455] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:16 2022] DELETE /identity/v3/users/50ca1fcef6174c7e812077408449f9d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:16.581288 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:16.593604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d7dde-87d2-4d66-ad11-24d24e2ff32c service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:16.658881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:16.660022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:16.660386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:16.660710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] PATH_INFO: `/v3/projects/e14fab80ba0044d5a9875ab6920b9e39` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:16.662577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14fab80ba0044d5a9875ab6920b9e39)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:16.665394 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:16.715925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14fab80ba0044d5a9875ab6920b9e39', 'request_id': 'req-86823cef-4db9-41ff-81a2-68c5dddafc32'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.721984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14fab80ba0044d5a9875ab6920b9e39', 'request_id': 'req-86823cef-4db9-41ff-81a2-68c5dddafc32'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.730120 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14fab80ba0044d5a9875ab6920b9e39', 'request_id': 'req-86823cef-4db9-41ff-81a2-68c5dddafc32'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.742598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] The token cache is being invalidate because project e14fab80ba0044d5a9875ab6920b9e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:16.742888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.743964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.745625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1229/2456] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:16 2022] DELETE /identity/v3/projects/e14fab80ba0044d5a9875ab6920b9e39 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:16.755224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:16.757088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:16.771672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262043a-8c7b-4618-a5d9-0893f6fee61d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:16.832485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:16.833452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:16.833737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:16.834012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] PATH_INFO: `/v3/users/b70fbb5c19554746966274f7c3896429` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:16.835202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70fbb5c19554746966274f7c3896429)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:16.837169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:16.889532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70fbb5c19554746966274f7c3896429'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.896369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70fbb5c19554746966274f7c3896429'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.897042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70fbb5c19554746966274f7c3896429'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.897652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70fbb5c19554746966274f7c3896429'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.911139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c999122d-14f0-4724-9f0b-c56ca0b4b12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70fbb5c19554746966274f7c3896429'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:16.924536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1228/2457] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:16 2022] DELETE /identity/v3/users/b70fbb5c19554746966274f7c3896429 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:17.108676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:17.110392 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:17.123442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86823cef-4db9-41ff-81a2-68c5dddafc32 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:17.152251 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:17.189479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:17.190406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:17.190683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:17.190964 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] PATH_INFO: `/v3/projects/2bc3f4cb48964a52a9836f078ef9fa1c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:17.192128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc3f4cb48964a52a9836f078ef9fa1c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:17.194069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:17.244007 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc3f4cb48964a52a9836f078ef9fa1c', 'request_id': 'req-820468ba-96e0-4614-92dd-8ce8dd49a4e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:17.250250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc3f4cb48964a52a9836f078ef9fa1c', 'request_id': 'req-820468ba-96e0-4614-92dd-8ce8dd49a4e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:17.258788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc3f4cb48964a52a9836f078ef9fa1c', 'request_id': 'req-820468ba-96e0-4614-92dd-8ce8dd49a4e2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:17.269245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] The token cache is being invalidate because project 2bc3f4cb48964a52a9836f078ef9fa1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:17.269532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:17.270155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:17.271726 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1230/2458] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:17 2022] DELETE /identity/v3/projects/2bc3f4cb48964a52a9836f078ef9fa1c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:26.920990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=75,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:27.266243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:34.562187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:34.562705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:34.562804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:34.581828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:34.583264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:34.645831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1229/2459] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:36:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:34.658526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:34.666654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:34.757686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820468ba-96e0-4614-92dd-8ce8dd49a4e2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:34.762932 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:34.763599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:34.763997 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:34.764280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:34.773285 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:34.774983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:34.784247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1231/2460] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:36:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:36:44.236203 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:44.239066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:44.305840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33747fd9-c1b5-4067-bbae-d7f879dccf46 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:44.309632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e43326-588f-4876-9999-2b83df278c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:44.310291 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e43326-588f-4876-9999-2b83df278c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:44.310576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e43326-588f-4876-9999-2b83df278c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:44.311149 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e43326-588f-4876-9999-2b83df278c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:44.313323 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-62e43326-588f-4876-9999-2b83df278c22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:44.416799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e43326-588f-4876-9999-2b83df278c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:44.418303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e43326-588f-4876-9999-2b83df278c22 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:44.444337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1230/2461] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:44.717821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:44.719319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:44.797898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba38f2b-4a54-443b-8169-713a41f80ffa service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:44.802521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:44.803417 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:44.803698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:44.803970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] PATH_INFO: `/v3/users/5eb3f51d356f4cea97ccfad93accff4f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:44.805181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb3f51d356f4cea97ccfad93accff4f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:44.807112 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:44.855874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb3f51d356f4cea97ccfad93accff4f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:44.863070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb3f51d356f4cea97ccfad93accff4f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:44.863811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb3f51d356f4cea97ccfad93accff4f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:44.864408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb3f51d356f4cea97ccfad93accff4f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:44.876949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb3f51d356f4cea97ccfad93accff4f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:44.888575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:44.894398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1232/2462] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:44 2022] DELETE /identity/v3/users/5eb3f51d356f4cea97ccfad93accff4f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:44.899385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:44.899670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:44.899946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:44.917801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:44.919381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:44.946676 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:44.990298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1231/2463] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:36:45.000382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:45.001925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:45.066666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103ce3c-6005-4322-a3ff-dc5a1df5bf27 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:45.070751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:45.071407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:45.071688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:45.071955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:45.081450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:45.083196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:45.092898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1233/2464] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:45.471462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:45.473812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:45.485917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69dfc77-2a86-47b6-a854-3a61239fb838 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:45.492084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:45.492998 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:45.493259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:45.493707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] PATH_INFO: `/v3/projects/2c9906457fac43cbbe86e81a78b712a3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:45.494988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9906457fac43cbbe86e81a78b712a3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:45.496940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:45.558717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9906457fac43cbbe86e81a78b712a3', 'request_id': 'req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.568365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9906457fac43cbbe86e81a78b712a3', 'request_id': 'req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.574566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9906457fac43cbbe86e81a78b712a3', 'request_id': 'req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.590334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] The token cache is being invalidate because project 2c9906457fac43cbbe86e81a78b712a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:45.590911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.591762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.593684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:45.594025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1232/2465] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:45 2022] DELETE /identity/v3/projects/2c9906457fac43cbbe86e81a78b712a3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:45.595515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:45.598231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:45.600131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:45.673423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27b0fa-2eb4-4ba0-a990-c582d7c82dc3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:45.678191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:45.678379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3b5f7-d622-40fb-bbf9-55fe766a2481 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:45.679091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:45.679373 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:45.679645 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] PATH_INFO: `/v3/users/dd4a8b891a034a719ac3e46a03052e3c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:45.680860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4a8b891a034a719ac3e46a03052e3c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:45.682840 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:45.730399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4a8b891a034a719ac3e46a03052e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.735206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:45.738399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4a8b891a034a719ac3e46a03052e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.739647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4a8b891a034a719ac3e46a03052e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.740379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4a8b891a034a719ac3e46a03052e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.745737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:45.746403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:45.746696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:45.746968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:45.748814 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:45.754125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4a8b891a034a719ac3e46a03052e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:45.768682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1233/2466] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:45 2022] DELETE /identity/v3/users/dd4a8b891a034a719ac3e46a03052e3c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:36:45.784449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:45.809096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:45.810717 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:45.820354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1234/2467] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:36:45.875499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:45.877305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:45.941128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6cd63-0b98-4777-af4d-99e479b911f1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:45.945120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd667e1-1d01-45e2-99e8-93327c6eafa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:45.945865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd667e1-1d01-45e2-99e8-93327c6eafa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:45.946243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd667e1-1d01-45e2-99e8-93327c6eafa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:45.946582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd667e1-1d01-45e2-99e8-93327c6eafa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:45.948440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2cd667e1-1d01-45e2-99e8-93327c6eafa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:46.024992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd667e1-1d01-45e2-99e8-93327c6eafa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.026430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd667e1-1d01-45e2-99e8-93327c6eafa1 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.038034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1234/2468] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:46.059404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.061431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:46.076850 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b15f0-c716-42c6-93c3-41a699b4d5f3 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.156738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.157647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.158136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.158360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] PATH_INFO: `/v3/projects/94d66ba60b084c349d82969da2bfd656` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.159721 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d66ba60b084c349d82969da2bfd656)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.162060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.215383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d66ba60b084c349d82969da2bfd656', 'request_id': 'req-a71a45f4-f5ad-4f90-ade7-229014a10fe7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:46.221478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d66ba60b084c349d82969da2bfd656', 'request_id': 'req-a71a45f4-f5ad-4f90-ade7-229014a10fe7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:46.229661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d66ba60b084c349d82969da2bfd656', 'request_id': 'req-a71a45f4-f5ad-4f90-ade7-229014a10fe7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:46.240962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] The token cache is being invalidate because project 94d66ba60b084c349d82969da2bfd656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:46.241250 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:46.241889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a71a45f4-f5ad-4f90-ade7-229014a10fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:46.243508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1235/2469] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:46 2022] DELETE /identity/v3/projects/94d66ba60b084c349d82969da2bfd656 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:46.249671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e938-a5ff-41f7-b2e8-804c9629746a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.249972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e938-a5ff-41f7-b2e8-804c9629746a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.250256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e938-a5ff-41f7-b2e8-804c9629746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.268646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2911e938-a5ff-41f7-b2e8-804c9629746a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:46.269956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2911e938-a5ff-41f7-b2e8-804c9629746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:46.333896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1235/2470] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:46.345791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083994e6-a755-4804-9414-23cd0320edd6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.346122 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083994e6-a755-4804-9414-23cd0320edd6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.346510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083994e6-a755-4804-9414-23cd0320edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.366357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-083994e6-a755-4804-9414-23cd0320edd6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:46.367565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-083994e6-a755-4804-9414-23cd0320edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:46.376265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1236/2471] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:46.381288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911e938-a5ff-41f7-b2e8-804c9629746a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.391259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911e938-a5ff-41f7-b2e8-804c9629746a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.396862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.397525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.397813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.398091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.398823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:36:46.399130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.400739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.407928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:46.415086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1236/2472] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:36:46.420358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083994e6-a755-4804-9414-23cd0320edd6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.429840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083994e6-a755-4804-9414-23cd0320edd6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.434666 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.435328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.435614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.435888 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.436577 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.438536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.469060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1237/2473] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:36:46 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:46.470292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.480479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811833-2507-4fbb-82e1-9c8739bf1e21 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.538183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.538876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.539151 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.539424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.540090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.542081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.564240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1237/2474] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:36:46 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:46.568691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.579286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b676e-8997-42d9-b69c-495288d09769 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.584227 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.584876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.585159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.585431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.586181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.587786 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.598408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1238/2475] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:46.602646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.613855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845d7a-938c-4128-8a4e-e3de4d733908 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.618667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7ac3-36fd-4627-b972-e173b8acd187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.619339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7ac3-36fd-4627-b972-e173b8acd187 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.619632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7ac3-36fd-4627-b972-e173b8acd187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.619901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7ac3-36fd-4627-b972-e173b8acd187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.620674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a7ac3-36fd-4627-b972-e173b8acd187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.622346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a7ac3-36fd-4627-b972-e173b8acd187 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.633845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1238/2476] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:46.637706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.648004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855e833-863b-4ad2-80fd-564f9a33a5b7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.653032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.653947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.654224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.654493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] PATH_INFO: `/v3/projects/9dcfd448fa684362b15a70b4d455ea49/users/2993b62a2fb541f3ac3b3c4e350fd9ff/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.670159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcfd448fa684362b15a70b4d455ea49, user_id=2993b62a2fb541f3ac3b3c4e350fd9ff, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.672860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.686128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1239/2477] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:46 2022] PUT /identity/v3/projects/9dcfd448fa684362b15a70b4d455ea49/users/2993b62a2fb541f3ac3b3c4e350fd9ff/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:46.701989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168501e-59f8-400e-a067-e628a1517156 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.702272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168501e-59f8-400e-a067-e628a1517156 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.702546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168501e-59f8-400e-a067-e628a1517156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.728773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7168501e-59f8-400e-a067-e628a1517156 None None] MFA Rules not processed for user `2993b62a2fb541f3ac3b3c4e350fd9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:46.730033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7168501e-59f8-400e-a067-e628a1517156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:46.797399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1239/2478] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:46.802074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.807108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:46.866470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19727e8-f211-4efe-a7a2-1bcad42d01e5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.871513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.872177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.872459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.872775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.873473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.875435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.907385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1240/2479] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:36:46 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:46.912257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168501e-59f8-400e-a067-e628a1517156 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:46.923548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168501e-59f8-400e-a067-e628a1517156 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:46.984849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:46.985533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:46.985813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:46.986115 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:46.986823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:46.988861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:46.998697 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:47.017821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1240/2480] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:36:46 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:36:47.021983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.032908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec003a-1ceb-45e2-9f43-7b030fe4b6e6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.038321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.039081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.039433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.039773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.040567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.042299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.054718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1241/2481] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:47.058960 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.069804 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d0aa-ff5c-453e-960f-fab5f90598e4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.074806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbc13d-f78c-4baf-b0f0-5b3f56e127c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.075472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbc13d-f78c-4baf-b0f0-5b3f56e127c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.075756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbc13d-f78c-4baf-b0f0-5b3f56e127c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.076029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbc13d-f78c-4baf-b0f0-5b3f56e127c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.076783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbc13d-f78c-4baf-b0f0-5b3f56e127c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.078462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbc13d-f78c-4baf-b0f0-5b3f56e127c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.088681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1241/2482] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:47.094522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.105969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee47f73-a6ec-4997-8576-6fcb5988776f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.111508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.112405 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.112685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.113018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] PATH_INFO: `/v3/projects/c6c4bfdeac3244298e3b86d318a23c56/users/25f928c0a2fa4d65a44d5cfcbdc6cecb/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.129181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c4bfdeac3244298e3b86d318a23c56, user_id=25f928c0a2fa4d65a44d5cfcbdc6cecb, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.131826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.148014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1242/2483] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:47 2022] PUT /identity/v3/projects/c6c4bfdeac3244298e3b86d318a23c56/users/25f928c0a2fa4d65a44d5cfcbdc6cecb/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:47.159240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c761d2-7f4f-4bb9-88a7-e6dcc6bc8d56 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.159528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c761d2-7f4f-4bb9-88a7-e6dcc6bc8d56 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.159901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c761d2-7f4f-4bb9-88a7-e6dcc6bc8d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.196144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-96c761d2-7f4f-4bb9-88a7-e6dcc6bc8d56 None None] MFA Rules not processed for user `25f928c0a2fa4d65a44d5cfcbdc6cecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:47.197575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-96c761d2-7f4f-4bb9-88a7-e6dcc6bc8d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:47.272598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1242/2484] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:47.277205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.349029 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90752-c383-4b31-9515-1e743ca14055 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.354065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.354740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.355022 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.355297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.355992 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.357970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.386275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1243/2485] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:36:47 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:47.390313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c761d2-7f4f-4bb9-88a7-e6dcc6bc8d56 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.401689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c761d2-7f4f-4bb9-88a7-e6dcc6bc8d56 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.461060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.461918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.462170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.462470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.463130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.465090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.485590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1243/2486] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:36:47 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:47.489753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.499801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d698d-b674-456e-9561-8bae5bde9881 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.504357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.505046 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.505323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.505608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.506328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.507921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.518858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1244/2487] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:47.523885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.537380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf0e00-ec53-4427-84d4-19105f91c7c6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.543249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.544517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.544828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.545103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] PATH_INFO: `/v3/projects/b1970bd3486d4de7b9ff39ddbf30be39/users/949bb0d0f86c4199b90315aa1dc126aa/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.563397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1970bd3486d4de7b9ff39ddbf30be39, user_id=949bb0d0f86c4199b90315aa1dc126aa, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.566176 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.586907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1244/2488] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:47 2022] PUT /identity/v3/projects/b1970bd3486d4de7b9ff39ddbf30be39/users/949bb0d0f86c4199b90315aa1dc126aa/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:47.591473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.606440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bae4f4-52e3-4cb2-9031-b171b67ebf7b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.631699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:47.669894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3677416-b7c2-436e-8be0-6990aff825db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.670604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677416-b7c2-436e-8be0-6990aff825db admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.670891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677416-b7c2-436e-8be0-6990aff825db admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.671182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3677416-b7c2-436e-8be0-6990aff825db admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.671898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3677416-b7c2-436e-8be0-6990aff825db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.673677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3677416-b7c2-436e-8be0-6990aff825db admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.683907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1245/2489] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:36:47.688584 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.699239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89b7f-7813-4e73-b2ba-d498bc353bda admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.703882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.704805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.705088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.705362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] PATH_INFO: `/v3/projects/b1970bd3486d4de7b9ff39ddbf30be39/users/949bb0d0f86c4199b90315aa1dc126aa/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.707404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1970bd3486d4de7b9ff39ddbf30be39, user_id=949bb0d0f86c4199b90315aa1dc126aa, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.710163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.720773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1245/2490] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:47 2022] PUT /identity/v3/projects/b1970bd3486d4de7b9ff39ddbf30be39/users/949bb0d0f86c4199b90315aa1dc126aa/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:47.731365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b4ad-fc9b-468e-87ec-72f488155c24 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.731658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b4ad-fc9b-468e-87ec-72f488155c24 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.731939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2b4ad-fc9b-468e-87ec-72f488155c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.759390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-40d2b4ad-fc9b-468e-87ec-72f488155c24 None None] MFA Rules not processed for user `949bb0d0f86c4199b90315aa1dc126aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:47.760856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-40d2b4ad-fc9b-468e-87ec-72f488155c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:47.837606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1246/2491] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:47.847678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:47.849558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:47.888239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:47.924602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70573471-252f-46c6-83c3-7b6eb3b2f3b0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:47.928641 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90d773-6236-4aff-9f0e-10b996aff4fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:47.929342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90d773-6236-4aff-9f0e-10b996aff4fa service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:47.929620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90d773-6236-4aff-9f0e-10b996aff4fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:47.929888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90d773-6236-4aff-9f0e-10b996aff4fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:47.940923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90d773-6236-4aff-9f0e-10b996aff4fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:47.942413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90d773-6236-4aff-9f0e-10b996aff4fa service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:47.952535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1246/2492] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:36:47.993631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2b4ad-fc9b-468e-87ec-72f488155c24 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:48.004778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2b4ad-fc9b-468e-87ec-72f488155c24 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:48.008451 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410563c-3dae-41be-8a5b-861843d9265f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:48.009127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410563c-3dae-41be-8a5b-861843d9265f service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:48.009408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410563c-3dae-41be-8a5b-861843d9265f service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:48.009675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410563c-3dae-41be-8a5b-861843d9265f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:48.128609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410563c-3dae-41be-8a5b-861843d9265f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:48.130790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410563c-3dae-41be-8a5b-861843d9265f service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:48.151881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1247/2493] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:49.539089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cb21b-711e-4f2a-94e8-fab1bfd35fa7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:49.539647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cb21b-711e-4f2a-94e8-fab1bfd35fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:49.539647 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cb21b-711e-4f2a-94e8-fab1bfd35fa7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:49.541039 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1247/2494] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:36:49.549915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d385c4-981c-45af-be04-d7f9ca8c83a6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:49.551582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d385c4-981c-45af-be04-d7f9ca8c83a6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:49.551982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d385c4-981c-45af-be04-d7f9ca8c83a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:49.596179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c5d385c4-981c-45af-be04-d7f9ca8c83a6 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:49.598184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c5d385c4-981c-45af-be04-d7f9ca8c83a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:49.650981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:49.722539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1248/2495] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:36:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:49.737953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cb21b-711e-4f2a-94e8-fab1bfd35fa7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:49.740063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4e0cb21b-711e-4f2a-94e8-fab1bfd35fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:49.844984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cb21b-711e-4f2a-94e8-fab1bfd35fa7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:49.849191 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1e49c-7576-4099-aefd-31ceca493ae6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:49.849854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1e49c-7576-4099-aefd-31ceca493ae6 service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:49.850136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1e49c-7576-4099-aefd-31ceca493ae6 service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:49.850416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1e49c-7576-4099-aefd-31ceca493ae6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:49.863754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1e49c-7576-4099-aefd-31ceca493ae6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:49.865359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1e49c-7576-4099-aefd-31ceca493ae6 service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:49.876688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1248/2496] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:36:49.953095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283f27-d2b9-48f6-8fa1-f1178a0990c9 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:49.953390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283f27-d2b9-48f6-8fa1-f1178a0990c9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:49.953670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283f27-d2b9-48f6-8fa1-f1178a0990c9 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:49.955115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1249/2497] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:36:49.960423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66da4d-42dd-4b4d-be98-63bae6161d6e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:49.960871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66da4d-42dd-4b4d-be98-63bae6161d6e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:49.961368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66da4d-42dd-4b4d-be98-63bae6161d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:49.988839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3c66da4d-42dd-4b4d-be98-63bae6161d6e None None] MFA Rules not processed for user `795571c4c2cc4f969ce487c0ec6dfbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:49.990065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3c66da4d-42dd-4b4d-be98-63bae6161d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:50.051723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1249/2498] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:36:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:50.066287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3283f27-d2b9-48f6-8fa1-f1178a0990c9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:50.068248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3283f27-d2b9-48f6-8fa1-f1178a0990c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:50.081961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3283f27-d2b9-48f6-8fa1-f1178a0990c9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:50.085514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5eadb-d66c-4373-a114-2e8ae2ff1883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:50.086157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5eadb-d66c-4373-a114-2e8ae2ff1883 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:50.086435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5eadb-d66c-4373-a114-2e8ae2ff1883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:50.086716 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5eadb-d66c-4373-a114-2e8ae2ff1883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:50.093748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5eadb-d66c-4373-a114-2e8ae2ff1883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:50.095320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5eadb-d66c-4373-a114-2e8ae2ff1883 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:50.103934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1250/2499] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:50.192825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8df18-088c-4db7-a15b-8bc76bc20377 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:50.193128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8df18-088c-4db7-a15b-8bc76bc20377 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:50.193408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8df18-088c-4db7-a15b-8bc76bc20377 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:50.194851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1250/2500] 10.222.0.66 () {54 vars in 921 bytes} [Thu Jun 23 11:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:36:50.200526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681795b-bae0-457d-8fd3-9da8ac45a901 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:50.200877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681795b-bae0-457d-8fd3-9da8ac45a901 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:50.201136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681795b-bae0-457d-8fd3-9da8ac45a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:50.220661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0681795b-bae0-457d-8fd3-9da8ac45a901 None None] MFA Rules not processed for user `bb2aadd5a1204d35a8325b3d56d20b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:50.221917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0681795b-bae0-457d-8fd3-9da8ac45a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:50.233340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1251/2501] 10.222.0.66 () {58 vars in 1018 bytes} [Thu Jun 23 11:36:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:50.244694 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8df18-088c-4db7-a15b-8bc76bc20377 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:50.256870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8df18-088c-4db7-a15b-8bc76bc20377 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:50.260646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e5f41-7e07-47a8-99d4-95f93b633494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:50.261312 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5f41-7e07-47a8-99d4-95f93b633494 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:50.261588 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5f41-7e07-47a8-99d4-95f93b633494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:50.261858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5f41-7e07-47a8-99d4-95f93b633494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:50.276276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e5f41-7e07-47a8-99d4-95f93b633494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:50.278090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e5f41-7e07-47a8-99d4-95f93b633494 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:50.295257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1251/2502] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:51.157917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681795b-bae0-457d-8fd3-9da8ac45a901 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:51.225986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681795b-bae0-457d-8fd3-9da8ac45a901 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:51.231024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:51.231920 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:51.232200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:51.232473 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] PATH_INFO: `/v3/users/2993b62a2fb541f3ac3b3c4e350fd9ff` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:51.233677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2993b62a2fb541f3ac3b3c4e350fd9ff)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:51.235874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:51.289268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2993b62a2fb541f3ac3b3c4e350fd9ff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:51.297092 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2993b62a2fb541f3ac3b3c4e350fd9ff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:51.297895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2993b62a2fb541f3ac3b3c4e350fd9ff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:51.298605 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2993b62a2fb541f3ac3b3c4e350fd9ff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:51.312565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2993b62a2fb541f3ac3b3c4e350fd9ff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:51.326056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1252/2503] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:51 2022] DELETE /identity/v3/users/2993b62a2fb541f3ac3b3c4e350fd9ff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:51.330797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:51.331274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:51.336418 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:51.366415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:51.367651 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:51.412701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:51.430554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1252/2504] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:51.440409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:51.441976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:51.470673 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:51.509818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f394f3-50b3-4c85-bb96-dd12711eb3ca admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:51.514026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:51.514682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:51.514967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:51.515247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:51.524989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:51.526432 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:51.536182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1253/2505] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:36:52.262665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:52.264135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:52.277926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4d34a-cd62-4fbe-850e-7e4dc362cda8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:52.284023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:52.285202 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:52.285513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:52.285885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] PATH_INFO: `/v3/projects/9dcfd448fa684362b15a70b4d455ea49` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:52.287306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcfd448fa684362b15a70b4d455ea49)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:52.289389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:52.342297 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcfd448fa684362b15a70b4d455ea49', 'request_id': 'req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.348942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcfd448fa684362b15a70b4d455ea49', 'request_id': 'req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.355615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcfd448fa684362b15a70b4d455ea49', 'request_id': 'req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.371047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] The token cache is being invalidate because project 9dcfd448fa684362b15a70b4d455ea49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:52.371462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.372272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.374048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1253/2506] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:52 2022] DELETE /identity/v3/projects/9dcfd448fa684362b15a70b4d455ea49 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:36:52.378159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:52.388114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fc30e-3a7d-4972-af28-d8bb032f0c1f service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:52.445787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:52.446757 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:52.447056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:52.447442 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] PATH_INFO: `/v3/users/25f928c0a2fa4d65a44d5cfcbdc6cecb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:52.448695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f928c0a2fa4d65a44d5cfcbdc6cecb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:52.450648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:52.499946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f928c0a2fa4d65a44d5cfcbdc6cecb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.507249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f928c0a2fa4d65a44d5cfcbdc6cecb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.507935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f928c0a2fa4d65a44d5cfcbdc6cecb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.508526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f928c0a2fa4d65a44d5cfcbdc6cecb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.521082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f928c0a2fa4d65a44d5cfcbdc6cecb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.536548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1254/2507] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:52 2022] DELETE /identity/v3/users/25f928c0a2fa4d65a44d5cfcbdc6cecb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:52.848405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:52.850076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:52.866623 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b37df-7b8f-43b8-bf44-5e677a7e2e3c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:52.933735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:52.934533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:52.934808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:52.935053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] PATH_INFO: `/v3/projects/c6c4bfdeac3244298e3b86d318a23c56` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:52.936224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c4bfdeac3244298e3b86d318a23c56)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:52.938179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:52.989077 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c4bfdeac3244298e3b86d318a23c56', 'request_id': 'req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:52.995567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c4bfdeac3244298e3b86d318a23c56', 'request_id': 'req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.002256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c4bfdeac3244298e3b86d318a23c56', 'request_id': 'req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.017652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] The token cache is being invalidate because project c6c4bfdeac3244298e3b86d318a23c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:53.017941 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.019071 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dcd81997-6cc0-4bfe-ba84-a7855bcc0efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.020574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1254/2508] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:52 2022] DELETE /identity/v3/projects/c6c4bfdeac3244298e3b86d318a23c56 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:53.024879 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:53.026427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:53.040401 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26036b-3670-4031-adc9-50cf8921d1a4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:53.113574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:53.129739 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:53.130638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:53.131050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:53.131434 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] PATH_INFO: `/v3/users/949bb0d0f86c4199b90315aa1dc126aa` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:53.132828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=949bb0d0f86c4199b90315aa1dc126aa)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:53.134901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:53.186269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949bb0d0f86c4199b90315aa1dc126aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.195245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949bb0d0f86c4199b90315aa1dc126aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.195969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949bb0d0f86c4199b90315aa1dc126aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.196661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949bb0d0f86c4199b90315aa1dc126aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.212154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949bb0d0f86c4199b90315aa1dc126aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:53.229783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1255/2509] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:53 2022] DELETE /identity/v3/users/949bb0d0f86c4199b90315aa1dc126aa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:53.300136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:53.300624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:53.301008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:53.309068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:53.346778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:53.349611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:53.485470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1255/2510] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:36:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:53.509045 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:53.511013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:53.646925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6450e6-daf0-41c7-83e2-60dfe3fefb6f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:53.653234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32693ac7-5e6e-4772-8dc3-0a7372b50001 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:53.654056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32693ac7-5e6e-4772-8dc3-0a7372b50001 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:53.654389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32693ac7-5e6e-4772-8dc3-0a7372b50001 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:53.654748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32693ac7-5e6e-4772-8dc3-0a7372b50001 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:53.667299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32693ac7-5e6e-4772-8dc3-0a7372b50001 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:53.669934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32693ac7-5e6e-4772-8dc3-0a7372b50001 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:53.681226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1256/2511] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:36:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:36:53.759350 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:53.761120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:53.887792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89574fa-5441-4e1d-8f4b-8a511a1eed5b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:53.900192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:53.902156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:53.903014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:53.903545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] PATH_INFO: `/v3/projects/b1970bd3486d4de7b9ff39ddbf30be39` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:53.907005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1970bd3486d4de7b9ff39ddbf30be39)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:53.910613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:54.010541 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1970bd3486d4de7b9ff39ddbf30be39', 'request_id': 'req-62663773-f3e3-456f-8520-c669fc826494'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:54.018981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1970bd3486d4de7b9ff39ddbf30be39', 'request_id': 'req-62663773-f3e3-456f-8520-c669fc826494'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:54.030566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1970bd3486d4de7b9ff39ddbf30be39', 'request_id': 'req-62663773-f3e3-456f-8520-c669fc826494'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:54.054217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] The token cache is being invalidate because project b1970bd3486d4de7b9ff39ddbf30be39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:54.054496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:54.055216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-62663773-f3e3-456f-8520-c669fc826494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:54.061305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1256/2512] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:53 2022] DELETE /identity/v3/projects/b1970bd3486d4de7b9ff39ddbf30be39 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:54.067548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fb1c-dfaf-4520-8d87-be5194a3c190 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.068034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fb1c-dfaf-4520-8d87-be5194a3c190 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.068315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fb1c-dfaf-4520-8d87-be5194a3c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.099782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e278fb1c-dfaf-4520-8d87-be5194a3c190 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:54.113689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e278fb1c-dfaf-4520-8d87-be5194a3c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:54.202144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:54.232063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1257/2513] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:54.233455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437337f-97a3-4b7e-9630-e02b8328f449 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.234131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437337f-97a3-4b7e-9630-e02b8328f449 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.234514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437337f-97a3-4b7e-9630-e02b8328f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.256974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d437337f-97a3-4b7e-9630-e02b8328f449 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:54.258227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d437337f-97a3-4b7e-9630-e02b8328f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:54.271869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278fb1c-dfaf-4520-8d87-be5194a3c190 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:54.272443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1257/2514] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:36:54.282009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278fb1c-dfaf-4520-8d87-be5194a3c190 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:54.287068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:54.287764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.288053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.288467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.289264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:36:54.289570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:54.291208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:54.311090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437337f-97a3-4b7e-9630-e02b8328f449 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:54.316903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1258/2515] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:36:54.322139 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437337f-97a3-4b7e-9630-e02b8328f449 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:54.327045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:54.327739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.328017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.328290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.329033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:54.330977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:54.365819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1258/2516] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:36:54 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:36:54.370487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:54.387514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62553731-5ba4-4813-bddd-5d36da01df71 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:54.536926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:54.537621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.537894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.538170 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.538877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:54.541730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:54.596607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1259/2517] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:36:54 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:54.600533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:54.619738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9e83e-2ba1-4611-bc4c-26ba2879e127 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:54.624855 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:54.625903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.626398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.626857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.627782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:54.630692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:54.633580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:54.646495 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1259/2518] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:54.650476 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:54.662684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2692f45-86f9-4d5d-a977-ee4fe185f163 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:54.679802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f6178-937a-4fa4-8a48-1ff2840e38ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:54.680497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6178-937a-4fa4-8a48-1ff2840e38ca admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.680800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6178-937a-4fa4-8a48-1ff2840e38ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.681078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f6178-937a-4fa4-8a48-1ff2840e38ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.681807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f6178-937a-4fa4-8a48-1ff2840e38ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:54.683440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f6178-937a-4fa4-8a48-1ff2840e38ca admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:54.696895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1260/2519] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:54.701090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:54.713890 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabde81-92af-4fd8-8708-634392dc3946 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:54.718985 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:54.720179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.720487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.720854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] PATH_INFO: `/v3/projects/c49169c2eea848328503eb2c488e5597/users/8d329b1723034205a6fcdd1100c164ee/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.756540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49169c2eea848328503eb2c488e5597, user_id=8d329b1723034205a6fcdd1100c164ee, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:54.760083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:54.781127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1260/2520] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:54 2022] PUT /identity/v3/projects/c49169c2eea848328503eb2c488e5597/users/8d329b1723034205a6fcdd1100c164ee/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:54.793976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccc70c-29af-4f2a-99f4-d612d282f592 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:54.794278 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccc70c-29af-4f2a-99f4-d612d282f592 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:54.794839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccc70c-29af-4f2a-99f4-d612d282f592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:54.861691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-82ccc70c-29af-4f2a-99f4-d612d282f592 None None] MFA Rules not processed for user `8d329b1723034205a6fcdd1100c164ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:54.863024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-82ccc70c-29af-4f2a-99f4-d612d282f592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:54.962638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1261/2521] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:54.975729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:54.977532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:55.073780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fb79f-69d5-44da-ba51-1017208d0e7f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:55.077547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6405e-2fde-41c7-9571-b233beea65db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:55.078224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6405e-2fde-41c7-9571-b233beea65db service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:55.078512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6405e-2fde-41c7-9571-b233beea65db service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:55.078763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6405e-2fde-41c7-9571-b233beea65db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:55.089256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6405e-2fde-41c7-9571-b233beea65db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:55.090875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6405e-2fde-41c7-9571-b233beea65db service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:55.102086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1261/2522] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:58.286573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccc70c-29af-4f2a-99f4-d612d282f592 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:58.342943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:58.358049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccc70c-29af-4f2a-99f4-d612d282f592 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:58.364166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:58.365282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:58.365611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:58.365866 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] PATH_INFO: `/v3/users/8d329b1723034205a6fcdd1100c164ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:58.367076 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d329b1723034205a6fcdd1100c164ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:58.369050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:58.431048 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d329b1723034205a6fcdd1100c164ee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:58.441957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d329b1723034205a6fcdd1100c164ee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:58.442802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d329b1723034205a6fcdd1100c164ee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:58.444225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d329b1723034205a6fcdd1100c164ee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:58.465839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d329b1723034205a6fcdd1100c164ee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:58.480115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1262/2523] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:36:58 2022] DELETE /identity/v3/users/8d329b1723034205a6fcdd1100c164ee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:58.484842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:58.485330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:58.485443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:58.508396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:58.509837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:58.604114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1262/2524] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:58.615487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:58.617318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:58.691127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7544f-a221-47da-a19f-24bf08f7777e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:58.695340 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3935eed-9a76-458a-a38b-0648215efbf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:58.696128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935eed-9a76-458a-a38b-0648215efbf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:58.696515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935eed-9a76-458a-a38b-0648215efbf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:58.697079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935eed-9a76-458a-a38b-0648215efbf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:58.708891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3935eed-9a76-458a-a38b-0648215efbf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:58.710702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3935eed-9a76-458a-a38b-0648215efbf8 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:58.731175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1263/2525] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:36:59.037479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.039025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:59.053589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a782d08-0acb-4080-a21c-561be663eaee None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.060001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.061621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.062090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.062364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] PATH_INFO: `/v3/projects/c49169c2eea848328503eb2c488e5597` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.063811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49169c2eea848328503eb2c488e5597)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.065768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:59.158626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49169c2eea848328503eb2c488e5597', 'request_id': 'req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:59.168880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49169c2eea848328503eb2c488e5597', 'request_id': 'req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:59.175061 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49169c2eea848328503eb2c488e5597', 'request_id': 'req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:59.186671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:59.191359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] The token cache is being invalidate because project c49169c2eea848328503eb2c488e5597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:36:59.191658 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:59.192705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea6f4c63-ab59-4806-9edf-19f6cec5e9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:36:59.199363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1263/2526] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:36:59 2022] DELETE /identity/v3/projects/c49169c2eea848328503eb2c488e5597 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:59.203693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881039-5fa6-436c-b26c-d0563f9160d2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.203693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881039-5fa6-436c-b26c-d0563f9160d2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.203693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881039-5fa6-436c-b26c-d0563f9160d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.237769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-62881039-5fa6-436c-b26c-d0563f9160d2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:59.239359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-62881039-5fa6-436c-b26c-d0563f9160d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:59.321181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1264/2527] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:59.329236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682ece-e9df-4053-a374-0de21436efcb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.329430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682ece-e9df-4053-a374-0de21436efcb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.329744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682ece-e9df-4053-a374-0de21436efcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.350517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-78682ece-e9df-4053-a374-0de21436efcb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:59.351876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-78682ece-e9df-4053-a374-0de21436efcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:59.360290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1264/2528] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:59.365171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62881039-5fa6-436c-b26c-d0563f9160d2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.375895 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62881039-5fa6-436c-b26c-d0563f9160d2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.381995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.383080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.383529 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.388788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.389873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:36:59.390276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.392730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:59.404031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:59.414761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682ece-e9df-4053-a374-0de21436efcb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.417072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1265/2529] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:36:59.425184 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682ece-e9df-4053-a374-0de21436efcb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.430179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.430853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.431132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.431404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.432095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.434056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:59.459842 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1265/2530] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:36:59 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:36:59.464367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.478231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbecf0-8a27-40f3-bb84-2d8d006f68ae admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.545729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.546409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.546698 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.546968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.547670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.549644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:59.593615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1266/2531] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:36:59 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:36:59.594883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.610894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933a36b-8d3c-4a31-a5fa-3a80e4fe08df admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.617917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.618831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.619116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.619374 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.620178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.622398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:59.638456 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1266/2532] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:36:59.642613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.653973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09ac9a-bb57-48f4-b854-d341aba19d81 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.658628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e7400-cf39-44cb-a18b-d8ce712168ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.659475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e7400-cf39-44cb-a18b-d8ce712168ef admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.661678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e7400-cf39-44cb-a18b-d8ce712168ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.661678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e7400-cf39-44cb-a18b-d8ce712168ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.673327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e7400-cf39-44cb-a18b-d8ce712168ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.675304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e7400-cf39-44cb-a18b-d8ce712168ef admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:59.705598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1267/2533] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:36:59.707006 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.722922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9c04-09b4-4c44-837f-a23937399991 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.727899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.728885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.729166 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.729443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] PATH_INFO: `/v3/projects/46ab3e616e9c4b4d91dc3c4767276b51/users/881a1351d74448cd8557d07eec06aec5/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.745916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ab3e616e9c4b4d91dc3c4767276b51, user_id=881a1351d74448cd8557d07eec06aec5, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.748571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:36:59.764845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1267/2534] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:36:59 2022] PUT /identity/v3/projects/46ab3e616e9c4b4d91dc3c4767276b51/users/881a1351d74448cd8557d07eec06aec5/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:36:59.776036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db2ee-5f6a-46ed-a992-00ba316de43f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.776302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db2ee-5f6a-46ed-a992-00ba316de43f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.776590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db2ee-5f6a-46ed-a992-00ba316de43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.822854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0e5db2ee-5f6a-46ed-a992-00ba316de43f None None] MFA Rules not processed for user `881a1351d74448cd8557d07eec06aec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:36:59.824264 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0e5db2ee-5f6a-46ed-a992-00ba316de43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:59.899941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1268/2535] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:36:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:36:59.912469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:36:59.914529 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:36:59.977836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bedeb9-f432-4b02-833c-c39dc01fb8ac admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:36:59.981661 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:36:59.982330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:36:59.982608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:36:59.982875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:36:59.992597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:36:59.994432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:00.004823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1268/2536] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:36:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:04.233057 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db2ee-5f6a-46ed-a992-00ba316de43f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:04.246344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db2ee-5f6a-46ed-a992-00ba316de43f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:04.250869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad19d4-5de3-4d12-b6bb-ce7c46b7b358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:04.251531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad19d4-5de3-4d12-b6bb-ce7c46b7b358 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:04.251813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad19d4-5de3-4d12-b6bb-ce7c46b7b358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:04.252087 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad19d4-5de3-4d12-b6bb-ce7c46b7b358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:04.254236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f7ad19d4-5de3-4d12-b6bb-ce7c46b7b358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:04.318774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad19d4-5de3-4d12-b6bb-ce7c46b7b358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:04.320253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad19d4-5de3-4d12-b6bb-ce7c46b7b358 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:04.329624 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1269/2537] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:06.783893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:06.785370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:06.857640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d8811c-d7f3-4007-9d68-36c27c140ee4 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:06.861403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:06.862159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:06.862539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:06.862909 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:06.865107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:06.935827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:06.950545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:06.952159 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:06.963279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1269/2538] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:09.637940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eea455-fced-4903-8f10-4a7388e516b5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:09.638431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eea455-fced-4903-8f10-4a7388e516b5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:09.638538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eea455-fced-4903-8f10-4a7388e516b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:09.652889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:09.663523 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-46eea455-fced-4903-8f10-4a7388e516b5 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:09.665237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-46eea455-fced-4903-8f10-4a7388e516b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:09.731800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1270/2539] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jun 23 11:37:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:09.756070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:09.759342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:09.839273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc3a35-f7aa-4045-a391-e2591b243170 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:09.844421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:09.845146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:09.845427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:09.845700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:09.854142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:09.855742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:09.865258 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1270/2540] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:37:10.378430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eea455-fced-4903-8f10-4a7388e516b5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:10.400934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eea455-fced-4903-8f10-4a7388e516b5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:10.411247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:10.412798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:10.419425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:10.419425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] PATH_INFO: `/v3/users/881a1351d74448cd8557d07eec06aec5` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:10.422189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] RBAC: Authorizing `identity:delete_user(user_id=881a1351d74448cd8557d07eec06aec5)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:10.424321 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:10.490331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:10.491814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:10.513887 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d485c7b-055c-418d-8248-466ba8de5fea service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:10.522390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:10.523752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:10.524038 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:10.524313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] PATH_INFO: `/v3/users/73c9e36a6c5f4bc8962ef86d39c496cb` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:10.525629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c9e36a6c5f4bc8962ef86d39c496cb)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:10.527783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881a1351d74448cd8557d07eec06aec5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.528138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:10.538638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881a1351d74448cd8557d07eec06aec5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.539380 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881a1351d74448cd8557d07eec06aec5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.541169 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881a1351d74448cd8557d07eec06aec5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.561647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bb792c0a-f640-4cb4-a670-04a951c5ddca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881a1351d74448cd8557d07eec06aec5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.579821 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1271/2541] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:37:10 2022] DELETE /identity/v3/users/881a1351d74448cd8557d07eec06aec5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:10.581302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:10.581595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:10.581955 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:10.590913 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c9e36a6c5f4bc8962ef86d39c496cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.601012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:10.602291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:10.603206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c9e36a6c5f4bc8962ef86d39c496cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.603723 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c9e36a6c5f4bc8962ef86d39c496cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.604345 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c9e36a6c5f4bc8962ef86d39c496cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.624969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c9e36a6c5f4bc8962ef86d39c496cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.642389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1271/2542] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:37:10 2022] DELETE /identity/v3/users/73c9e36a6c5f4bc8962ef86d39c496cb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:37:10.672369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1272/2543] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:10.682346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:10.683845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:10.753250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cb8dc-db51-4e88-b6a6-6ff12f20a7e4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:10.757620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d016fb0-3b3b-4278-ba9f-98c80fd51d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:10.758369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d016fb0-3b3b-4278-ba9f-98c80fd51d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:10.758717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d016fb0-3b3b-4278-ba9f-98c80fd51d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:10.759617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d016fb0-3b3b-4278-ba9f-98c80fd51d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:10.765313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:10.839220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:10.839401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d016fb0-3b3b-4278-ba9f-98c80fd51d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:10.840655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:10.840979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d016fb0-3b3b-4278-ba9f-98c80fd51d13 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:10.853048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1272/2544] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:10.853672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27058cd2-50ff-42af-93e7-c1b6fd9cf673 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:10.859377 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:10.860597 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:10.861043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:10.861480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] PATH_INFO: `/v3/projects/70553711ebfc423ea1cf7b6c3cababd9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:10.862884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70553711ebfc423ea1cf7b6c3cababd9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:10.864893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:10.890223 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:10.928765 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70553711ebfc423ea1cf7b6c3cababd9', 'request_id': 'req-c9070fa4-a59b-49af-ab07-0f315c5c4a22'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.936006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70553711ebfc423ea1cf7b6c3cababd9', 'request_id': 'req-c9070fa4-a59b-49af-ab07-0f315c5c4a22'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.943862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70553711ebfc423ea1cf7b6c3cababd9', 'request_id': 'req-c9070fa4-a59b-49af-ab07-0f315c5c4a22'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.955316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] The token cache is being invalidate because project 70553711ebfc423ea1cf7b6c3cababd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:37:10.955741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.956389 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9070fa4-a59b-49af-ab07-0f315c5c4a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:10.958082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1273/2545] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:37:10 2022] DELETE /identity/v3/projects/70553711ebfc423ea1cf7b6c3cababd9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:37:10.963961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53acb90-0cd7-46db-b80e-b5f75d5a89fe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:10.964284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53acb90-0cd7-46db-b80e-b5f75d5a89fe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:10.964644 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53acb90-0cd7-46db-b80e-b5f75d5a89fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:10.983393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e53acb90-0cd7-46db-b80e-b5f75d5a89fe None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:10.984865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e53acb90-0cd7-46db-b80e-b5f75d5a89fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.049366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1273/2546] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:11.057788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92339549-f1c2-475e-9a7f-b2832dd6c962 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.058071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92339549-f1c2-475e-9a7f-b2832dd6c962 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.058551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92339549-f1c2-475e-9a7f-b2832dd6c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.078985 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-92339549-f1c2-475e-9a7f-b2832dd6c962 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:11.080195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-92339549-f1c2-475e-9a7f-b2832dd6c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.088596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1274/2547] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:11.093157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53acb90-0cd7-46db-b80e-b5f75d5a89fe None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.104322 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53acb90-0cd7-46db-b80e-b5f75d5a89fe None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.110111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.110820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.111070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.111343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.112076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:37:11.112384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.114155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.126366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1274/2548] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:37:11.132313 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92339549-f1c2-475e-9a7f-b2832dd6c962 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.143677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92339549-f1c2-475e-9a7f-b2832dd6c962 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.146482 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.148225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.149534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.150211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.150489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.150761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.151481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.154303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.162977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88e06a-53ea-4b87-bce4-6ca80266ed63 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.170060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.170906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.171188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.173271 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] PATH_INFO: `/v3/projects/46ab3e616e9c4b4d91dc3c4767276b51` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.175136 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ab3e616e9c4b4d91dc3c4767276b51)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.177359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.189576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1275/2549] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:37:11.190894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.228793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ab3e616e9c4b4d91dc3c4767276b51', 'request_id': 'req-15447df3-9241-4af8-8bcb-91548e1ea0e6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:11.235752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ab3e616e9c4b4d91dc3c4767276b51', 'request_id': 'req-15447df3-9241-4af8-8bcb-91548e1ea0e6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:11.241994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ab3e616e9c4b4d91dc3c4767276b51', 'request_id': 'req-15447df3-9241-4af8-8bcb-91548e1ea0e6'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:11.255279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9de73-0d8e-4744-84ae-d5e8c1b5f202 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.256612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] The token cache is being invalidate because project 46ab3e616e9c4b4d91dc3c4767276b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:37:11.256931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:11.257555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15447df3-9241-4af8-8bcb-91548e1ea0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:11.259187 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1275/2550] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:37:11 2022] DELETE /identity/v3/projects/46ab3e616e9c4b4d91dc3c4767276b51 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:37:11.264142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f4673-2e02-4580-91d3-645c8ca701bf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.264433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f4673-2e02-4580-91d3-645c8ca701bf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.264729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f4673-2e02-4580-91d3-645c8ca701bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.282096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b40f4673-2e02-4580-91d3-645c8ca701bf None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:11.283298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b40f4673-2e02-4580-91d3-645c8ca701bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.288763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:11.313334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.314017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.314296 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.314570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.315255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.317925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.337790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1276/2551] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:37:11.341980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.343696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.346466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1276/2552] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:37:11.354285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21dd9-b43b-4395-8dba-3018ce82878e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.354566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21dd9-b43b-4395-8dba-3018ce82878e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.354836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d21dd9-b43b-4395-8dba-3018ce82878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.358348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeea4c4-b759-4009-bf2a-7595016a8080 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.363565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.364233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.364517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.364828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.365561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.367175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.373953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-26d21dd9-b43b-4395-8dba-3018ce82878e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:11.375168 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-26d21dd9-b43b-4395-8dba-3018ce82878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.381235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1277/2553] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:37:11.381936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.387141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1277/2554] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:37:11.388236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:11.388934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21dd9-b43b-4395-8dba-3018ce82878e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.392710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fea53-ba1c-492d-b40e-9bbb6b73773b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.399154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d21dd9-b43b-4395-8dba-3018ce82878e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.399383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.400107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.400506 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.400703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.401635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.404003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.404274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.404942 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.405368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.405490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.406193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:37:11.406493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.408080 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.416566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1278/2555] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:37:11.421336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.426689 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1278/2556] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:37:11.428127 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.432304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7014de8-cab6-402f-b01f-fadb1af85032 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.437160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a136878-372f-4507-93ad-1c1641002a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.437981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8812e-835a-4432-b2d0-3a18c85f0591 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.438098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a136878-372f-4507-93ad-1c1641002a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.438348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a136878-372f-4507-93ad-1c1641002a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.438745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a136878-372f-4507-93ad-1c1641002a91 admin admin] PATH_INFO: `/v3/projects/499b1def7bc14c4c9143af0f34b2be9e/users/a37f2a1caf4c483095c5927885e9f8d2/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.443171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.443816 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.444103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.444382 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.445131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.447020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.453345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a136878-372f-4507-93ad-1c1641002a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499b1def7bc14c4c9143af0f34b2be9e, user_id=a37f2a1caf4c483095c5927885e9f8d2, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.455979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a136878-372f-4507-93ad-1c1641002a91 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.470771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1279/2557] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:37:11 2022] PUT /identity/v3/projects/499b1def7bc14c4c9143af0f34b2be9e/users/a37f2a1caf4c483095c5927885e9f8d2/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:11.477341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1279/2558] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:37:11.477508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.477508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.477508 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.478873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.494691 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:11.496006 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.542006 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdcdd3-11b5-466a-b3fc-a0d3fcdda515 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.547043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.547727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.548008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.548286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.549005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.550974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.555512 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1280/2559] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:11.566114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.567729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.576311 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1280/2560] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:37:11.577353 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.586899 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477e10f-665b-430c-8008-968cd779676e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.591531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.592212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.592493 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.592756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.593478 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.595064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.605261 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1281/2561] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:37:11.609033 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.619962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebba17-dc88-42d8-89c3-37f77282a307 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.624777 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.625422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.625699 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.625974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.626727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.627427 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d9b7b-c41d-4389-ba14-a2f88fae1243 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.628327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.631193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17854b8c-8e50-40b1-bf5a-e4802692a6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.631839 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854b8c-8e50-40b1-bf5a-e4802692a6ae service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.632107 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854b8c-8e50-40b1-bf5a-e4802692a6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.632388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17854b8c-8e50-40b1-bf5a-e4802692a6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.639199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1282/2562] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:37:11.641806 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854b8c-8e50-40b1-bf5a-e4802692a6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.643179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.643314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17854b8c-8e50-40b1-bf5a-e4802692a6ae service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.653020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fa3ac-c615-4bcd-8b16-c91e03a77b0a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.653950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1281/2563] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:11.658526 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.659447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.659743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.660008 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] PATH_INFO: `/v3/projects/254b2e95839d421ca6f90e75b2df1ac2/users/d45ceae3a93b40fb9770ea8c74607815/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.676026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254b2e95839d421ca6f90e75b2df1ac2, user_id=d45ceae3a93b40fb9770ea8c74607815, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.678944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.692257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1283/2564] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:37:11 2022] PUT /identity/v3/projects/254b2e95839d421ca6f90e75b2df1ac2/users/d45ceae3a93b40fb9770ea8c74607815/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:37:11.697675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47980ce2-f2e2-4540-adf9-fa762ac6ed0e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.698212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47980ce2-f2e2-4540-adf9-fa762ac6ed0e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.698521 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47980ce2-f2e2-4540-adf9-fa762ac6ed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.717099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-47980ce2-f2e2-4540-adf9-fa762ac6ed0e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:11.718327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-47980ce2-f2e2-4540-adf9-fa762ac6ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.782606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1282/2565] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:11.793409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:11.795223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:11.811741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:11.865231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e06f8-5218-4b64-856e-faa473219940 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:11.869284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:11.869957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:11.870256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:11.870536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:11.880276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:11.881746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:11.891742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1284/2566] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:17.554456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e70cf-95e9-4f9c-9561-a6b65ec5f93a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:17.554944 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e70cf-95e9-4f9c-9561-a6b65ec5f93a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:17.555054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e70cf-95e9-4f9c-9561-a6b65ec5f93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:17.598566 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:17.602595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-327e70cf-95e9-4f9c-9561-a6b65ec5f93a None None] MFA Rules not processed for user `a37f2a1caf4c483095c5927885e9f8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:17.604174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-327e70cf-95e9-4f9c-9561-a6b65ec5f93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:17.714931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1283/2567] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:17.715734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:17.717227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:17.829208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626a801-e4b1-443a-be76-5a2ffe9f259e service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:17.837779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:17.838615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:17.838990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:17.839362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:17.856850 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:17.862470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:17.887160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1285/2568] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:18.039636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5721-e0ba-45f1-9749-f3c847e40da0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:18.039959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5721-e0ba-45f1-9749-f3c847e40da0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:18.040234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c5721-e0ba-45f1-9749-f3c847e40da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:18.082299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0e7c5721-e0ba-45f1-9749-f3c847e40da0 None None] MFA Rules not processed for user `d45ceae3a93b40fb9770ea8c74607815`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:18.083548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0e7c5721-e0ba-45f1-9749-f3c847e40da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:18.200491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1284/2569] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:18.203249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:18.219403 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446608-48d9-42d0-8131-6e21503006d8 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:18.226631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:18.227368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:18.227671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:18.228043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:18.229066 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:18.231925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:18.275481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1286/2570] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:37:18 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:37:18.277619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5721-e0ba-45f1-9749-f3c847e40da0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:18.291584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c5721-e0ba-45f1-9749-f3c847e40da0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:18.382773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:18.383478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:18.383761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:18.384038 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:18.384775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:18.386948 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:18.413159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1285/2571] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:37:18 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:37:18.417132 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:18.435337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a6e5-3cde-460a-8e0c-a2db67a99cca admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:18.441625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:18.442528 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:18.442817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:18.443122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:18.443846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:18.445538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:18.466991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1287/2572] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:37:18.468220 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:18.481295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03481-46ec-4a2c-a189-58520d416fd2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:18.487592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:18.489125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:18.489533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:18.489885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] PATH_INFO: `/v3/projects/91a59ba9e8b044beb0f0fef7e1143e71/users/dd9c8a7b42ca41e6a0345a3a1ecfa635/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:18.513872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a59ba9e8b044beb0f0fef7e1143e71, user_id=dd9c8a7b42ca41e6a0345a3a1ecfa635, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:18.519078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:18.535755 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:18.545322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1286/2573] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:37:18 2022] PUT /identity/v3/projects/91a59ba9e8b044beb0f0fef7e1143e71/users/dd9c8a7b42ca41e6a0345a3a1ecfa635/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:18.546832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:18.560409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c39cf-8e35-4894-9151-8d02c6c0fcb9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:18.630945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e78cdf-654c-40c2-a4cb-b914487ba89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:18.631751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e78cdf-654c-40c2-a4cb-b914487ba89c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:18.632097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e78cdf-654c-40c2-a4cb-b914487ba89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:18.632442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e78cdf-654c-40c2-a4cb-b914487ba89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:18.633442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e78cdf-654c-40c2-a4cb-b914487ba89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:18.635144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e78cdf-654c-40c2-a4cb-b914487ba89c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:18.646324 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1288/2574] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:37:18.650562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:18.661848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570b24f-e038-4e97-ac94-adecb184d782 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:18.670258 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31551272-886d-453d-b222-4a3276880069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:18.671242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31551272-886d-453d-b222-4a3276880069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:18.671526 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31551272-886d-453d-b222-4a3276880069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:18.671799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31551272-886d-453d-b222-4a3276880069 admin admin] PATH_INFO: `/v3/projects/91a59ba9e8b044beb0f0fef7e1143e71/users/dd9c8a7b42ca41e6a0345a3a1ecfa635/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:18.674572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31551272-886d-453d-b222-4a3276880069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a59ba9e8b044beb0f0fef7e1143e71, user_id=dd9c8a7b42ca41e6a0345a3a1ecfa635, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:18.679188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31551272-886d-453d-b222-4a3276880069 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:18.691749 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1287/2575] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:37:18 2022] PUT /identity/v3/projects/91a59ba9e8b044beb0f0fef7e1143e71/users/dd9c8a7b42ca41e6a0345a3a1ecfa635/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:19.738141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:19.739030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:19.739030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:19.750628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:19.768048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] MFA Rules not processed for user `a37f2a1caf4c483095c5927885e9f8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:19.769327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:19.882740 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1289/2576] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:20.337319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31551272-886d-453d-b222-4a3276880069 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:20.429756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31551272-886d-453d-b222-4a3276880069 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:20.434323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:20.435269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:20.435737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:20.436212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:20.438463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:20.452479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:20.457260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:20.481129 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1288/2577] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:20.996266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:20.998265 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:21.136734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb773d84-4d6f-40ca-b49a-f2a0421be589 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:21.142465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342b993-2d91-46c7-b664-3acf8d1463be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:21.143286 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342b993-2d91-46c7-b664-3acf8d1463be service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:21.143566 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342b993-2d91-46c7-b664-3acf8d1463be service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:21.144004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342b993-2d91-46c7-b664-3acf8d1463be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:21.146183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c342b993-2d91-46c7-b664-3acf8d1463be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:21.192219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342b993-2d91-46c7-b664-3acf8d1463be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:21.194610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342b993-2d91-46c7-b664-3acf8d1463be service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:21.219100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1290/2578] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:24.126841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:24.141937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33372a-d961-4f70-9ca2-e9d5e7cf7294 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:24.146606 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:24.147567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:24.148881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:24.149317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:24.152312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:24.185915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:24.193252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:24.230267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1289/2579] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:25.584357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:25.584883 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:25.584982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:25.612502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:25.649285 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] MFA Rules not processed for user `dd9c8a7b42ca41e6a0345a3a1ecfa635`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:25.650812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:25.796097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9c6a6-6e60-4dd9-a7d2-48466671ea38 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:25.809051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96df5c-84a6-401b-960f-e7d64f0946b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:25.810047 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96df5c-84a6-401b-960f-e7d64f0946b6 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:25.810841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96df5c-84a6-401b-960f-e7d64f0946b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:25.811276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96df5c-84a6-401b-960f-e7d64f0946b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:25.814090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca96df5c-84a6-401b-960f-e7d64f0946b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:25.833421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96df5c-84a6-401b-960f-e7d64f0946b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:25.835531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96df5c-84a6-401b-960f-e7d64f0946b6 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:25.858837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1291/2580] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:25.865072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1290/2581] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:25.866266 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:25.867711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:25.898426 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e3415-c561-41a1-9ce9-4112ceb33e05 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:25.906436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:25.907365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:25.907828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:25.908336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:25.947717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:26.005969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:26.010245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:26.022111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1292/2582] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:27.205589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e009-5bc5-4deb-b358-b5736aab1516 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:27.206097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e009-5bc5-4deb-b358-b5736aab1516 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:27.206097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5e009-5bc5-4deb-b358-b5736aab1516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:27.224339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-65c5e009-5bc5-4deb-b358-b5736aab1516 None None] MFA Rules not processed for user `d45ceae3a93b40fb9770ea8c74607815`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:27.225589 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-65c5e009-5bc5-4deb-b358-b5736aab1516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:27.233833 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1291/2583] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:32.475082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:32.488877 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6dd9c-1990-4477-95ad-894b3f2eabcb service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:32.494687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:32.495420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:32.495799 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:32.496143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:32.498041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:32.513688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:32.515307 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:32.526935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1293/2584] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:37.219153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:42.522083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=23 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:51.098115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e009-5bc5-4deb-b358-b5736aab1516 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:51.109044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5e009-5bc5-4deb-b358-b5736aab1516 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:51.113903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:51.114553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:51.114829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:51.115096 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:51.117322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:51.188488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:51.189981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:51.200669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1292/2585] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:53.506238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:53.516818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dbfbc-fc9f-45f9-82af-7a7f1a74edc7 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:53.520523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:53.521214 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:53.521513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:53.521782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:53.531525 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:53.532984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:53.543540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1294/2586] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:54.677890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:54.679851 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:54.693771 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ae6db-2775-4733-86f4-f4b326049ae0 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:54.698664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:54.699593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:54.699870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:54.700153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] PATH_INFO: `/v3/users/5a17f3ec8f4d43049b61688a0578cd2e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:54.701403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a17f3ec8f4d43049b61688a0578cd2e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:54.703331 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:54.754657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a17f3ec8f4d43049b61688a0578cd2e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:54.761942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a17f3ec8f4d43049b61688a0578cd2e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:54.762650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a17f3ec8f4d43049b61688a0578cd2e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:54.763587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a17f3ec8f4d43049b61688a0578cd2e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:54.776015 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6188c73d-e1fb-4423-a8db-966560cace84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a17f3ec8f4d43049b61688a0578cd2e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:54.794310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1293/2587] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:37:54 2022] DELETE /identity/v3/users/5a17f3ec8f4d43049b61688a0578cd2e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:55.007007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.021547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff3df-a4f8-4a85-a29b-c6df5c234eed service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.089325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.090253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.090612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.091017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] PATH_INFO: `/v3/projects/79f95e1a5e3648f3af0429bed0e6c171` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.092542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f95e1a5e3648f3af0429bed0e6c171)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.094480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.146735 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f95e1a5e3648f3af0429bed0e6c171', 'request_id': 'req-f66772dd-49a1-477a-bb0d-913c1e25b5a2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:55.152962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f95e1a5e3648f3af0429bed0e6c171', 'request_id': 'req-f66772dd-49a1-477a-bb0d-913c1e25b5a2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:55.159209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f95e1a5e3648f3af0429bed0e6c171', 'request_id': 'req-f66772dd-49a1-477a-bb0d-913c1e25b5a2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:55.173982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] The token cache is being invalidate because project 79f95e1a5e3648f3af0429bed0e6c171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:37:55.174342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:55.174981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f66772dd-49a1-477a-bb0d-913c1e25b5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:55.176653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1295/2588] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:37:55 2022] DELETE /identity/v3/projects/79f95e1a5e3648f3af0429bed0e6c171 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:55.181927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70dfd7-e414-4ea7-a620-1c11e24479a5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.182187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70dfd7-e414-4ea7-a620-1c11e24479a5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.182646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70dfd7-e414-4ea7-a620-1c11e24479a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.202379 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9a70dfd7-e414-4ea7-a620-1c11e24479a5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:55.203584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9a70dfd7-e414-4ea7-a620-1c11e24479a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:55.265268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1294/2589] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:37:55.273944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3f9b-9a64-4f2c-96c8-63e16de903a0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.274225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3f9b-9a64-4f2c-96c8-63e16de903a0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.274500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea3f9b-9a64-4f2c-96c8-63e16de903a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.293841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-64ea3f9b-9a64-4f2c-96c8-63e16de903a0 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:55.295090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64ea3f9b-9a64-4f2c-96c8-63e16de903a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:55.303674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1296/2590] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:37:55.308049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70dfd7-e414-4ea7-a620-1c11e24479a5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.318054 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70dfd7-e414-4ea7-a620-1c11e24479a5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.323030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.323693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.323971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.324260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.324996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:37:55.325310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.327073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.328669 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:55.340358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1295/2591] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:37:55.345521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3f9b-9a64-4f2c-96c8-63e16de903a0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.356660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea3f9b-9a64-4f2c-96c8-63e16de903a0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.362515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.363383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.363710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.363982 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.364705 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.366629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.402965 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1297/2592] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:37:55 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:37:55.407213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.417619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea413ee-3459-42b6-8c28-7369875fc54c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.480205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.480925 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.481207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.481480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.482764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.484753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.506440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1296/2593] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:37:55 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:37:55.510447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.521242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5cb1-b933-4353-864c-e65c10b80939 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.525861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.526530 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.526811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.527082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.527805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.529825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.543401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1298/2594] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:37:55.548667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.563450 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03138ba-0c38-40d2-bcc7-91fceb22ae76 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.571565 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.572316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.572555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.572999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.573783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.575622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.591672 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1297/2595] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:37:55.592555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.602008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.603183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c9b66-c008-4228-9f5c-0cb541f90c2b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.604128 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:55.611263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8718d0-eb65-44b1-b166-3985773f59f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.611263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8718d0-eb65-44b1-b166-3985773f59f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.611263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8718d0-eb65-44b1-b166-3985773f59f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.611263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8718d0-eb65-44b1-b166-3985773f59f2 admin admin] PATH_INFO: `/v3/projects/a538cd5e53474527a9ec4e47ce80ade4/users/3681024696e440ee9c3d83fa40cf856e/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.627896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8718d0-eb65-44b1-b166-3985773f59f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a538cd5e53474527a9ec4e47ce80ade4, user_id=3681024696e440ee9c3d83fa40cf856e, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.630923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8718d0-eb65-44b1-b166-3985773f59f2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.650079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1299/2596] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:37:55 2022] PUT /identity/v3/projects/a538cd5e53474527a9ec4e47ce80ade4/users/3681024696e440ee9c3d83fa40cf856e/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:55.663907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.663907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.663907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.673594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:55.699574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] MFA Rules not processed for user `3681024696e440ee9c3d83fa40cf856e`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:55.701156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:55.702049 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8de8-5595-4d93-9358-1b2d661e4161 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.774885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.775256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1300/2597] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:55.776165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.776674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.777151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.779798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:55.787219 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:55.788593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:55.792162 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:55.795858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.798802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.806888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2294-4617-4410-aa8b-c44fe248c8b1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:55.813007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3a122-fe84-4c86-b489-7bfcb3f7879a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:55.813224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1298/2598] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:55.814275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3a122-fe84-4c86-b489-7bfcb3f7879a service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:55.814559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3a122-fe84-4c86-b489-7bfcb3f7879a service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:55.814839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3a122-fe84-4c86-b489-7bfcb3f7879a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:55.825828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3a122-fe84-4c86-b489-7bfcb3f7879a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:55.827436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3a122-fe84-4c86-b489-7bfcb3f7879a service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:55.838886 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1301/2599] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:58.597902 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:58.665440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bb1af-e2fb-47cb-9d22-83edf5a73b1d service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:58.672754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:58.674040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:58.674472 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:58.674816 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] PATH_INFO: `/v3/users/3681024696e440ee9c3d83fa40cf856e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:58.676740 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3681024696e440ee9c3d83fa40cf856e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:58.678974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:58.744571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3681024696e440ee9c3d83fa40cf856e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:58.751986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3681024696e440ee9c3d83fa40cf856e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:58.752779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3681024696e440ee9c3d83fa40cf856e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:58.753310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3681024696e440ee9c3d83fa40cf856e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:58.766300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3681024696e440ee9c3d83fa40cf856e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:58.781263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1299/2600] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:37:58 2022] DELETE /identity/v3/users/3681024696e440ee9c3d83fa40cf856e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:58.785930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:58.786416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:58.786512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:58.806305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:58.807552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:58.869466 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1302/2601] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:37:58.879943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:58.881433 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:58.944196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad2675-9711-4cea-a89d-ac1e478d741e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:58.948538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0e02a-4030-451b-a099-91d3fb5fe988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:58.949234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0e02a-4030-451b-a099-91d3fb5fe988 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:58.949514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0e02a-4030-451b-a099-91d3fb5fe988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:58.949789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0e02a-4030-451b-a099-91d3fb5fe988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:58.960769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0e02a-4030-451b-a099-91d3fb5fe988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:58.963094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0e02a-4030-451b-a099-91d3fb5fe988 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:58.976026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1300/2602] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:59.272284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:59.273805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:59.288354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad14bf-1519-435e-bf05-31d04b7b1ab4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:59.294587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:59.295976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.295976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.296182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] PATH_INFO: `/v3/projects/a538cd5e53474527a9ec4e47ce80ade4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.297688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a538cd5e53474527a9ec4e47ce80ade4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:59.299615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:59.355299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a538cd5e53474527a9ec4e47ce80ade4', 'request_id': 'req-aee28cff-e3eb-4535-a81a-b07b063e12a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:59.362152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a538cd5e53474527a9ec4e47ce80ade4', 'request_id': 'req-aee28cff-e3eb-4535-a81a-b07b063e12a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:59.368841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a538cd5e53474527a9ec4e47ce80ade4', 'request_id': 'req-aee28cff-e3eb-4535-a81a-b07b063e12a5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:59.382805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] The token cache is being invalidate because project a538cd5e53474527a9ec4e47ce80ade4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:37:59.383044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:59.383750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-aee28cff-e3eb-4535-a81a-b07b063e12a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:37:59.385399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1303/2603] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:37:59 2022] DELETE /identity/v3/projects/a538cd5e53474527a9ec4e47ce80ade4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:59.390650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0b58b-73ff-482a-9f16-9cfbe8e66fc5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.390971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0b58b-73ff-482a-9f16-9cfbe8e66fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.391247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0b58b-73ff-482a-9f16-9cfbe8e66fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.408619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f0e0b58b-73ff-482a-9f16-9cfbe8e66fc5 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:59.409855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f0e0b58b-73ff-482a-9f16-9cfbe8e66fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:59.422840 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:59.473878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1301/2604] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:37:59.481929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dfd27-5e91-4f01-8cd2-2611448118cb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.482223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dfd27-5e91-4f01-8cd2-2611448118cb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.482504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17dfd27-5e91-4f01-8cd2-2611448118cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.490162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:59.502332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f17dfd27-5e91-4f01-8cd2-2611448118cb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:59.504155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f17dfd27-5e91-4f01-8cd2-2611448118cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:59.512496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1304/2605] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:59.517094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0b58b-73ff-482a-9f16-9cfbe8e66fc5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:59.527020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0b58b-73ff-482a-9f16-9cfbe8e66fc5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:59.533608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:59.534268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.534544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.534813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.535537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:37:59.535842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:59.537501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:59.551065 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1302/2606] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:37:59.555469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dfd27-5e91-4f01-8cd2-2611448118cb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:59.565352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17dfd27-5e91-4f01-8cd2-2611448118cb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:59.571597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:59.572570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.572969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.573347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.574367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:59.577198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:59.604704 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1305/2607] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:37:59 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:37:59.609537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:59.619774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40541-a113-4ae1-aea6-74c924559e69 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:59.690013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:59.690701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.690986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.691263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.691954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:59.693943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:59.715103 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1303/2608] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:37:59 2022] POST /identity/v3/users => generated 305 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:37:59.719572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:59.730309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2310e9-5aa8-40e8-b821-5790a2f81856 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:59.735301 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:59.735952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.736234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.736515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.737351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:59.738906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:59.749769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1306/2609] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:37:59.754581 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:59.769937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfab95-1a89-40da-ab44-2a60f83c6f53 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:59.776785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b85b4d-e1bb-408f-8db3-b06fa38a7443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:59.777753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b85b4d-e1bb-408f-8db3-b06fa38a7443 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.778141 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b85b4d-e1bb-408f-8db3-b06fa38a7443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.778464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b85b4d-e1bb-408f-8db3-b06fa38a7443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.779383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b85b4d-e1bb-408f-8db3-b06fa38a7443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:59.781196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b85b4d-e1bb-408f-8db3-b06fa38a7443 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:59.791836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1304/2610] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:37:59.796268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:37:59.806450 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45684be0-785c-4863-8702-1eef37373f74 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:37:59.811255 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:37:59.812126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.812387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.812657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] PATH_INFO: `/v3/projects/039cc30392e24f0883a3d039e72a6fa9/users/27b1d9e17034420cb662b3f199498149/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.827354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039cc30392e24f0883a3d039e72a6fa9, user_id=27b1d9e17034420cb662b3f199498149, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:37:59.830037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:37:59.845300 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1307/2611] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:37:59 2022] PUT /identity/v3/projects/039cc30392e24f0883a3d039e72a6fa9/users/27b1d9e17034420cb662b3f199498149/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:37:59.855805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0c32-0209-4bf9-8537-7530ae9265a0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:37:59.856088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0c32-0209-4bf9-8537-7530ae9265a0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:37:59.856361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0c32-0209-4bf9-8537-7530ae9265a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:37:59.884003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-adeb0c32-0209-4bf9-8537-7530ae9265a0 None None] MFA Rules not processed for user `27b1d9e17034420cb662b3f199498149`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:37:59.885255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-adeb0c32-0209-4bf9-8537-7530ae9265a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:37:59.960026 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1305/2612] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:37:59.964700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.035860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a153-ff91-48cf-aae0-99bb2f2cb207 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.046745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.046745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.046745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.046745 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.047232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.047232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.078206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1308/2613] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:37:59 2022] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:00.082562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb0c32-0209-4bf9-8537-7530ae9265a0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.094111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb0c32-0209-4bf9-8537-7530ae9265a0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.103927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:00.154088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.155267 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.155609 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.155940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.156625 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.158608 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.182479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1306/2614] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:00 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:00.188023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.198810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ca499-68bc-4b31-86f3-a7d7fd72dd0c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.204531 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.205222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.205504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.205774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.206509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.208114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.218990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1309/2615] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:00.223191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.234426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568653c-ee6c-48d3-a1be-68e59b11e14d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.240032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.240936 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.241219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.241490 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] PATH_INFO: `/v3/projects/38b702384e274b2a961f4bfb01a5a550/users/dac5a280e2d64e59b00f00b8290685f3/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.257342 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b702384e274b2a961f4bfb01a5a550, user_id=dac5a280e2d64e59b00f00b8290685f3, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.260106 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.274857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1307/2616] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:00 2022] PUT /identity/v3/projects/38b702384e274b2a961f4bfb01a5a550/users/dac5a280e2d64e59b00f00b8290685f3/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:00.278979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.289649 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4f4a-a3c6-443b-b9e7-2c18e2b3ef63 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.360398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488899d-654b-4ffc-abb2-301a3420af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.361104 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488899d-654b-4ffc-abb2-301a3420af40 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.361447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488899d-654b-4ffc-abb2-301a3420af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.361711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488899d-654b-4ffc-abb2-301a3420af40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.362467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488899d-654b-4ffc-abb2-301a3420af40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.364075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488899d-654b-4ffc-abb2-301a3420af40 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.374674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1310/2617] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:00.379036 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.390359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4b21d-cd34-49c7-b0f6-4f4f31ed8f50 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.395841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.396772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.397081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.397352 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] PATH_INFO: `/v3/projects/38b702384e274b2a961f4bfb01a5a550/users/dac5a280e2d64e59b00f00b8290685f3/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.399359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b702384e274b2a961f4bfb01a5a550, user_id=dac5a280e2d64e59b00f00b8290685f3, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.402034 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.413475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1308/2618] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:00 2022] PUT /identity/v3/projects/38b702384e274b2a961f4bfb01a5a550/users/dac5a280e2d64e59b00f00b8290685f3/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:00.425762 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8942-a01f-4770-9d45-fbb3e940c2c5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.426053 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8942-a01f-4770-9d45-fbb3e940c2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.426331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8942-a01f-4770-9d45-fbb3e940c2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.446175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:00.454210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1c1f8942-a01f-4770-9d45-fbb3e940c2c5 None None] MFA Rules not processed for user `dac5a280e2d64e59b00f00b8290685f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:00.456050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1c1f8942-a01f-4770-9d45-fbb3e940c2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:00.532788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1311/2619] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:00.544137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.546118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:00.605469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05551c8-c075-48f3-b283-46fca22f04cb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.609720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.610365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.610633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.610907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.620429 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.621892 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.631505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1309/2620] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:00.788615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8942-a01f-4770-9d45-fbb3e940c2c5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:00.799453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8942-a01f-4770-9d45-fbb3e940c2c5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:00.804075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6be74-f4e6-4136-9b27-642143040904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:00.804736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6be74-f4e6-4136-9b27-642143040904 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:00.805043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6be74-f4e6-4136-9b27-642143040904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:00.805321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6be74-f4e6-4136-9b27-642143040904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:00.865372 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6be74-f4e6-4136-9b27-642143040904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:00.866874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6be74-f4e6-4136-9b27-642143040904 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:00.876398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1312/2621] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:06.195440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:06.262145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e1364-2e15-4294-883e-c230862f67c8 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:06.267697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:06.268505 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:06.268825 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:06.269097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] PATH_INFO: `/v3/users/27b1d9e17034420cb662b3f199498149` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:06.270361 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b1d9e17034420cb662b3f199498149)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:06.272297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:06.282595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:06.322912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b1d9e17034420cb662b3f199498149'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.329594 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b1d9e17034420cb662b3f199498149'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.330809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b1d9e17034420cb662b3f199498149'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.331462 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b1d9e17034420cb662b3f199498149'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.343553 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b1d9e17034420cb662b3f199498149'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.358039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1310/2622] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:06 2022] DELETE /identity/v3/users/27b1d9e17034420cb662b3f199498149 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:06.362969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:06.363499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:06.363499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:06.381988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:06.383209 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:06.453420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1313/2623] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:06.465499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:06.467074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:06.526263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b38f63-dd8d-4677-ab00-afafad4e7474 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:06.530557 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:06.531206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:06.531488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:06.531760 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:06.541756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:06.543186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:06.552811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1311/2624] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:38:06.833144 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:06.834640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:06.850906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9848aab-2ee4-451b-985a-c26034de064b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:06.856365 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:06.857796 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:06.858054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:06.858549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] PATH_INFO: `/v3/projects/039cc30392e24f0883a3d039e72a6fa9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:06.859927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039cc30392e24f0883a3d039e72a6fa9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:06.862045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:06.899169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:06.912424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039cc30392e24f0883a3d039e72a6fa9', 'request_id': 'req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.919423 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039cc30392e24f0883a3d039e72a6fa9', 'request_id': 'req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.925838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039cc30392e24f0883a3d039e72a6fa9', 'request_id': 'req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.940427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] The token cache is being invalidate because project 039cc30392e24f0883a3d039e72a6fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:06.940737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.941370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:06.942953 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1314/2625] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:06 2022] DELETE /identity/v3/projects/039cc30392e24f0883a3d039e72a6fa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:06.947068 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:06.956941 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bbbc0-a3c3-4801-b5cb-b23ad6cf74bc service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:07.012940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:07.013827 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.014110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.014382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] PATH_INFO: `/v3/users/dac5a280e2d64e59b00f00b8290685f3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.015574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac5a280e2d64e59b00f00b8290685f3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:07.017593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:07.053921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:07.070339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac5a280e2d64e59b00f00b8290685f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.078198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac5a280e2d64e59b00f00b8290685f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.078917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac5a280e2d64e59b00f00b8290685f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.079537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac5a280e2d64e59b00f00b8290685f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.091954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1081aae0-ba22-4d7e-b620-d8b4ac1e44e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac5a280e2d64e59b00f00b8290685f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.105770 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1312/2626] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:06 2022] DELETE /identity/v3/users/dac5a280e2d64e59b00f00b8290685f3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:07.397181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:07.399587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:07.417621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8ecbd-f1ad-4bf5-b67b-b68509bad9a9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:07.490849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:07.491653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.491932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.492206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] PATH_INFO: `/v3/projects/38b702384e274b2a961f4bfb01a5a550` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.493428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b702384e274b2a961f4bfb01a5a550)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:07.495343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:07.558973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b702384e274b2a961f4bfb01a5a550', 'request_id': 'req-d52f84f3-e430-4ed8-a024-72d667801311'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.565338 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b702384e274b2a961f4bfb01a5a550', 'request_id': 'req-d52f84f3-e430-4ed8-a024-72d667801311'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.571107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b702384e274b2a961f4bfb01a5a550', 'request_id': 'req-d52f84f3-e430-4ed8-a024-72d667801311'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.589381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] The token cache is being invalidate because project 38b702384e274b2a961f4bfb01a5a550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:07.589820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.590828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d52f84f3-e430-4ed8-a024-72d667801311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:07.593262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1315/2627] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:07 2022] DELETE /identity/v3/projects/38b702384e274b2a961f4bfb01a5a550 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:07.599748 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6da941-2a6c-4e80-80f5-16ef19de5d6b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.600268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6da941-2a6c-4e80-80f5-16ef19de5d6b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.600381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6da941-2a6c-4e80-80f5-16ef19de5d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.627996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ce6da941-2a6c-4e80-80f5-16ef19de5d6b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:07.629243 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ce6da941-2a6c-4e80-80f5-16ef19de5d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:07.694305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1313/2628] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:07.702205 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6751d0-468b-4b07-9c80-93aa84c57b00 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.702500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6751d0-468b-4b07-9c80-93aa84c57b00 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.702771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6751d0-468b-4b07-9c80-93aa84c57b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.722175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8b6751d0-468b-4b07-9c80-93aa84c57b00 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:07.723368 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8b6751d0-468b-4b07-9c80-93aa84c57b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:07.731973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1316/2629] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:38:07.736329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6da941-2a6c-4e80-80f5-16ef19de5d6b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:07.746966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6da941-2a6c-4e80-80f5-16ef19de5d6b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:07.753028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:07.753766 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.753967 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.754245 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.754963 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:38:07.755283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:07.756913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:07.769595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1314/2630] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:38:07.774625 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6751d0-468b-4b07-9c80-93aa84c57b00 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:07.787571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6751d0-468b-4b07-9c80-93aa84c57b00 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:07.794181 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:07.794852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.795135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.795402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.796108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:07.798050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:07.829903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1317/2631] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:38:07 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:07.834975 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:07.848842 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b259e6e-f425-4ced-86b2-8e30a183e7f4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:07.907410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:07.908468 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.908618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.908927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.909615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:07.911524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:07.933962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1315/2632] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:07 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:07.938224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:07.949083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dbaf7-9d8e-4957-8d79-e0994d663875 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:07.955254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:07.956018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.956303 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.956574 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.957337 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:07.958933 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:07.970882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1318/2633] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:07.974942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:07.985763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e0e2a-e78a-406d-9b81-881ce5d7fa2a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:07.991481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c37f1a-a5fd-4355-86f2-19d4de97389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:07.992117 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c37f1a-a5fd-4355-86f2-19d4de97389b admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:07.992399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c37f1a-a5fd-4355-86f2-19d4de97389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:07.992679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c37f1a-a5fd-4355-86f2-19d4de97389b admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:07.993436 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c37f1a-a5fd-4355-86f2-19d4de97389b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:07.995016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c37f1a-a5fd-4355-86f2-19d4de97389b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.005393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1316/2634] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:08.009499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.019872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff21514-ace4-4872-ba77-d8ff73f569e8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.024841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.025718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.026001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.026276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] PATH_INFO: `/v3/projects/da7d2b99ecd348b8a75c7c86fe895a7e/users/3271f3c44ae04e9588578342514defd2/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.029399 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:08.046341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=da7d2b99ecd348b8a75c7c86fe895a7e, user_id=3271f3c44ae04e9588578342514defd2, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.046341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.061320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1319/2635] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:08 2022] PUT /identity/v3/projects/da7d2b99ecd348b8a75c7c86fe895a7e/users/3271f3c44ae04e9588578342514defd2/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:08.073219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e963-3ea8-45ba-bdc2-712abc506efd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.073587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e963-3ea8-45ba-bdc2-712abc506efd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.073944 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6e963-3ea8-45ba-bdc2-712abc506efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.110453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5ea6e963-3ea8-45ba-bdc2-712abc506efd None None] MFA Rules not processed for user `3271f3c44ae04e9588578342514defd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:08.112019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5ea6e963-3ea8-45ba-bdc2-712abc506efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:08.119544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:08.187538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1317/2636] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:08.194321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.270558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734b131-fb08-48cf-81f9-dbbb88de79cd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.277304 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.277978 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.278262 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.278502 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.279218 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.281153 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.311402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1320/2637] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:38:08 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:08.315773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6e963-3ea8-45ba-bdc2-712abc506efd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.326750 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6e963-3ea8-45ba-bdc2-712abc506efd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.385292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.386275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.386612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.386962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.387986 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.390890 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.416950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1318/2638] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:08 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:08.421122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.436199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dc813-101c-49cd-8ceb-41a49b4c8551 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.442431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.443121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.443405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.443671 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.444390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.446019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.458744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1321/2639] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:08.463265 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.475105 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98965-c18d-4779-9733-fb1940a1be21 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.481480 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.482387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.482652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.482922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] PATH_INFO: `/v3/projects/ac842a2344174a72b905cf3497c45805/users/bebb1a41e5b345b5841707228263c310/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.499276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac842a2344174a72b905cf3497c45805, user_id=bebb1a41e5b345b5841707228263c310, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.502648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.517309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1319/2640] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:08 2022] PUT /identity/v3/projects/ac842a2344174a72b905cf3497c45805/users/bebb1a41e5b345b5841707228263c310/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:08.522479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.536408 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a45c3-8964-4c6c-b7e1-59844562f47c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.596380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfa01c-25bc-440b-96ad-ee1ec7987eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.597083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa01c-25bc-440b-96ad-ee1ec7987eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.597361 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa01c-25bc-440b-96ad-ee1ec7987eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.597626 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfa01c-25bc-440b-96ad-ee1ec7987eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.598349 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfa01c-25bc-440b-96ad-ee1ec7987eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.599940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfa01c-25bc-440b-96ad-ee1ec7987eb9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.610012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1322/2641] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:08.614381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.625088 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129faa-d5cc-4b05-98fe-69cf2b9f8caf admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.630556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.631486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.631794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.632069 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] PATH_INFO: `/v3/projects/ac842a2344174a72b905cf3497c45805/users/bebb1a41e5b345b5841707228263c310/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.634134 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac842a2344174a72b905cf3497c45805, user_id=bebb1a41e5b345b5841707228263c310, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.636939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.647408 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1320/2642] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:08 2022] PUT /identity/v3/projects/ac842a2344174a72b905cf3497c45805/users/bebb1a41e5b345b5841707228263c310/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:08.659240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7411-fada-4ae5-b4ca-35e444ef4127 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.659806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7411-fada-4ae5-b4ca-35e444ef4127 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.660090 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7411-fada-4ae5-b4ca-35e444ef4127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.689570 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-021d7411-fada-4ae5-b4ca-35e444ef4127 None None] MFA Rules not processed for user `bebb1a41e5b345b5841707228263c310`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:08.690849 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-021d7411-fada-4ae5-b4ca-35e444ef4127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:08.736123 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:08.770416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1323/2643] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:08.781804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:08.784236 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:08.843515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92540ad5-263e-471a-9459-ccf681817df9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:08.847639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43174e0f-4a60-4874-9f61-914538e29296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:08.848281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43174e0f-4a60-4874-9f61-914538e29296 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:08.848535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43174e0f-4a60-4874-9f61-914538e29296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:08.848844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43174e0f-4a60-4874-9f61-914538e29296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:08.858807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:08.907607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43174e0f-4a60-4874-9f61-914538e29296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:08.909127 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43174e0f-4a60-4874-9f61-914538e29296 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:08.919354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1321/2644] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:13.163729 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7411-fada-4ae5-b4ca-35e444ef4127 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:13.179655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7411-fada-4ae5-b4ca-35e444ef4127 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:13.184126 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:13.184792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:13.185076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:13.185344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:13.195921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:13.197553 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:13.207967 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1324/2645] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:16.095685 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00bd5c-9a54-47ff-9ca0-f94c722784fd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:16.096226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00bd5c-9a54-47ff-9ca0-f94c722784fd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:16.096226 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00bd5c-9a54-47ff-9ca0-f94c722784fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:16.114154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8b00bd5c-9a54-47ff-9ca0-f94c722784fd None None] MFA Rules not processed for user `a37f2a1caf4c483095c5927885e9f8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:16.115410 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8b00bd5c-9a54-47ff-9ca0-f94c722784fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:16.173873 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1322/2646] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:18.181836 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:18.247766 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef728c-d8ac-47e0-b082-307d3f34257b service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:18.252503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:18.253428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:18.253712 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:18.253987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] PATH_INFO: `/v3/users/3271f3c44ae04e9588578342514defd2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:18.255206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3271f3c44ae04e9588578342514defd2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:18.257587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:18.311655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3271f3c44ae04e9588578342514defd2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:18.318587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3271f3c44ae04e9588578342514defd2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:18.319448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3271f3c44ae04e9588578342514defd2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:18.320069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3271f3c44ae04e9588578342514defd2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:18.332972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3271f3c44ae04e9588578342514defd2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:18.347488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1325/2647] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:18 2022] DELETE /identity/v3/users/3271f3c44ae04e9588578342514defd2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:38:18.353999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:18.354578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:18.354578 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:18.373829 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:18.375039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:18.434194 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1323/2648] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:38:18.444070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:18.445669 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:18.498362 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:18.504775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bebcd-82bf-4f91-abb6-8850d9ba0249 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:18.509576 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:18.510722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:18.511217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:18.511479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:18.521839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:18.523308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:18.533854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1326/2649] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:19.014846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:19.016395 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:19.028747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da8c7a-0d90-4d89-b16d-ee37eafd4809 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:19.034616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:19.035485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:19.035746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:19.036017 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] PATH_INFO: `/v3/projects/da7d2b99ecd348b8a75c7c86fe895a7e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:19.038319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da7d2b99ecd348b8a75c7c86fe895a7e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:19.039279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:19.105718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da7d2b99ecd348b8a75c7c86fe895a7e', 'request_id': 'req-866704d2-1ba0-40f8-aadc-b0e4a8da995d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.108874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:19.114620 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da7d2b99ecd348b8a75c7c86fe895a7e', 'request_id': 'req-866704d2-1ba0-40f8-aadc-b0e4a8da995d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.124305 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da7d2b99ecd348b8a75c7c86fe895a7e', 'request_id': 'req-866704d2-1ba0-40f8-aadc-b0e4a8da995d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.135155 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] The token cache is being invalidate because project da7d2b99ecd348b8a75c7c86fe895a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:19.135372 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.136025 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.137639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1324/2650] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:19 2022] DELETE /identity/v3/projects/da7d2b99ecd348b8a75c7c86fe895a7e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:19.141573 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:19.151505 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cce381-1fee-48b6-b7bc-9c6f432db0db service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:19.208001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:19.208918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:19.209236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:19.209510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] PATH_INFO: `/v3/users/bebb1a41e5b345b5841707228263c310` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:19.210871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bebb1a41e5b345b5841707228263c310)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:19.212880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:19.266131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bebb1a41e5b345b5841707228263c310'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.273976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bebb1a41e5b345b5841707228263c310'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.274709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bebb1a41e5b345b5841707228263c310'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.275591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bebb1a41e5b345b5841707228263c310'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.290088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7db5709-1279-4b79-9c97-031cf64f24d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bebb1a41e5b345b5841707228263c310'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:19.306348 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1327/2651] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:19 2022] DELETE /identity/v3/users/bebb1a41e5b345b5841707228263c310 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:19.890360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:19.892188 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:19.925148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866704d2-1ba0-40f8-aadc-b0e4a8da995d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:19.988944 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:19.989884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:19.990161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:19.990463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] PATH_INFO: `/v3/projects/ac842a2344174a72b905cf3497c45805` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:19.991785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac842a2344174a72b905cf3497c45805)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:19.993730 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.041962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac842a2344174a72b905cf3497c45805', 'request_id': 'req-89cfc1ab-d43a-46bb-9330-497abd7a92f8'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:20.048707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac842a2344174a72b905cf3497c45805', 'request_id': 'req-89cfc1ab-d43a-46bb-9330-497abd7a92f8'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:20.063534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac842a2344174a72b905cf3497c45805', 'request_id': 'req-89cfc1ab-d43a-46bb-9330-497abd7a92f8'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:20.075736 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] The token cache is being invalidate because project ac842a2344174a72b905cf3497c45805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:20.076016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:20.076650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89cfc1ab-d43a-46bb-9330-497abd7a92f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:20.078233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1325/2652] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:19 2022] DELETE /identity/v3/projects/ac842a2344174a72b905cf3497c45805 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:20.086079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77527f-8de6-49dd-838c-2855d3418b6c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.086363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77527f-8de6-49dd-838c-2855d3418b6c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.086635 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77527f-8de6-49dd-838c-2855d3418b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.106086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-be77527f-8de6-49dd-838c-2855d3418b6c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:20.107309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-be77527f-8de6-49dd-838c-2855d3418b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:20.166930 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1328/2653] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:38:20.175711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e795c-a42e-49a3-9c91-9aa165b992e2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.175896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e795c-a42e-49a3-9c91-9aa165b992e2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.176168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e795c-a42e-49a3-9c91-9aa165b992e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.194660 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0e0e795c-a42e-49a3-9c91-9aa165b992e2 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:20.195861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0e0e795c-a42e-49a3-9c91-9aa165b992e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:20.204407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1326/2654] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:20.209197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77527f-8de6-49dd-838c-2855d3418b6c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.219163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77527f-8de6-49dd-838c-2855d3418b6c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.224674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.225381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.225865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.226131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.226863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:38:20.227174 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.228866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.231427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:20.244316 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1329/2655] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:38:20.249281 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e795c-a42e-49a3-9c91-9aa165b992e2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.258791 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e795c-a42e-49a3-9c91-9aa165b992e2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.263745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.264435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.264737 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.265023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.265718 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.267670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.294858 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1327/2656] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:38:20 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:20.299385 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.309593 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d1622-4f1c-49d6-9b81-b523e1792745 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.373020 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.373693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.373974 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.374274 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.374951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.376952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.400610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1330/2657] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:20 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:20.404887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.416084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e156a3c-82b8-41ec-be53-d12d3ff93b73 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.420805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359107-961f-4008-9586-7af06836cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.421464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359107-961f-4008-9586-7af06836cace admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.421743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359107-961f-4008-9586-7af06836cace admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.422013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24359107-961f-4008-9586-7af06836cace admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.422743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359107-961f-4008-9586-7af06836cace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.424336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24359107-961f-4008-9586-7af06836cace admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.434789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1328/2658] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:20.439048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.449331 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7b181-a246-48f2-ab2c-1324cf1206f1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.454279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f44c93-c4ea-4915-8925-0f9d2853ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.454944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44c93-c4ea-4915-8925-0f9d2853ae44 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.455226 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44c93-c4ea-4915-8925-0f9d2853ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.455499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44c93-c4ea-4915-8925-0f9d2853ae44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.456273 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f44c93-c4ea-4915-8925-0f9d2853ae44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.457868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f44c93-c4ea-4915-8925-0f9d2853ae44 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.468063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1331/2659] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:20.472731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359107-961f-4008-9586-7af06836cace admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.483299 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24359107-961f-4008-9586-7af06836cace admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.487991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.488901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.489186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.489460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] PATH_INFO: `/v3/projects/9507ac8c56ba49a69a46c68b157431c7/users/f1047134a8b7400abc2ecb4ac075a8cb/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.504703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9507ac8c56ba49a69a46c68b157431c7, user_id=f1047134a8b7400abc2ecb4ac075a8cb, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.507524 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.523899 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1329/2660] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:20 2022] PUT /identity/v3/projects/9507ac8c56ba49a69a46c68b157431c7/users/f1047134a8b7400abc2ecb4ac075a8cb/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:20.536162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f048-cc75-4834-8a09-686551aa9b66 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.536445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f048-cc75-4834-8a09-686551aa9b66 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.536685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56f048-cc75-4834-8a09-686551aa9b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.568371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bb56f048-cc75-4834-8a09-686551aa9b66 None None] MFA Rules not processed for user `f1047134a8b7400abc2ecb4ac075a8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:20.570288 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bb56f048-cc75-4834-8a09-686551aa9b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:20.636898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1332/2661] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:20.644016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.657785 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:20.717070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23737e-fd85-4046-8e5d-7e187c81b705 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.722385 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.723050 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.723327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.723599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.724286 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.726386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.754856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1330/2662] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:38:20 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:20.759077 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f048-cc75-4834-8a09-686551aa9b66 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.769861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56f048-cc75-4834-8a09-686551aa9b66 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.827340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.828017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.828295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.828567 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.829287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.831207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.839748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:20.853882 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1333/2663] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:20 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:20.858391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.869743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b860166-4c7d-40a5-bb45-6cece4445806 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.875275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.875950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.876269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.876544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.877282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.879013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.890102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1331/2664] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:20.894335 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.905746 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036189a-9fe5-4c09-9728-f6a4d48469ae admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:20.911185 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:20.912078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:20.912443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:20.913000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] PATH_INFO: `/v3/projects/8b12ab1ed5144ed298241a6cdaab989a/users/6a0b309ba8734dbfb8a475e85c690a9b/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:20.929917 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b12ab1ed5144ed298241a6cdaab989a, user_id=6a0b309ba8734dbfb8a475e85c690a9b, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:20.932591 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:20.950367 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1334/2665] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:20 2022] PUT /identity/v3/projects/8b12ab1ed5144ed298241a6cdaab989a/users/6a0b309ba8734dbfb8a475e85c690a9b/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:20.954744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:20.965094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f668-3d48-468c-921b-ee3cf2dbcef6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:21.023085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd890-f6d6-4f3a-8b72-4b908a4b7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:21.023783 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd890-f6d6-4f3a-8b72-4b908a4b7404 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:21.024072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd890-f6d6-4f3a-8b72-4b908a4b7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:21.024341 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd890-f6d6-4f3a-8b72-4b908a4b7404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:21.025136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd890-f6d6-4f3a-8b72-4b908a4b7404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:21.026787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd890-f6d6-4f3a-8b72-4b908a4b7404 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:21.036972 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1332/2666] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:21.042259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:21.053050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83509b38-0c29-4c52-be19-279cba300524 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:21.058318 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:21.059230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:21.059958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:21.059958 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] PATH_INFO: `/v3/projects/8b12ab1ed5144ed298241a6cdaab989a/users/6a0b309ba8734dbfb8a475e85c690a9b/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:21.061961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b12ab1ed5144ed298241a6cdaab989a, user_id=6a0b309ba8734dbfb8a475e85c690a9b, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:21.064609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:21.075497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1335/2667] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:21 2022] PUT /identity/v3/projects/8b12ab1ed5144ed298241a6cdaab989a/users/6a0b309ba8734dbfb8a475e85c690a9b/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:38:21.086493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a794-f85f-4807-aaa9-ae460f897b80 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:21.086782 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a794-f85f-4807-aaa9-ae460f897b80 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:21.087055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a794-f85f-4807-aaa9-ae460f897b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:21.114382 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2401a794-f85f-4807-aaa9-ae460f897b80 None None] MFA Rules not processed for user `6a0b309ba8734dbfb8a475e85c690a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:21.115662 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2401a794-f85f-4807-aaa9-ae460f897b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:21.185140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1333/2668] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:21.196754 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:21.198885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:21.261888 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819edd6-160c-4de5-921c-c63395170dfa admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:21.265846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cab06-b1c8-4620-9f54-b4e91f019223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:21.266510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cab06-b1c8-4620-9f54-b4e91f019223 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:21.266793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cab06-b1c8-4620-9f54-b4e91f019223 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:21.267070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cab06-b1c8-4620-9f54-b4e91f019223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:21.325259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cab06-b1c8-4620-9f54-b4e91f019223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:21.326764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cab06-b1c8-4620-9f54-b4e91f019223 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:21.336872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1336/2669] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:23.903181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a794-f85f-4807-aaa9-ae460f897b80 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:23.908214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:23.972483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a794-f85f-4807-aaa9-ae460f897b80 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:23.978896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:23.979667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:23.979950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:23.980201 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] PATH_INFO: `/v3/users/f1047134a8b7400abc2ecb4ac075a8cb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:23.981532 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1047134a8b7400abc2ecb4ac075a8cb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:23.983465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:24.034021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1047134a8b7400abc2ecb4ac075a8cb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.042137 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1047134a8b7400abc2ecb4ac075a8cb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.045218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1047134a8b7400abc2ecb4ac075a8cb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.046002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1047134a8b7400abc2ecb4ac075a8cb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.062130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1047134a8b7400abc2ecb4ac075a8cb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.076474 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1334/2670] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:23 2022] DELETE /identity/v3/users/f1047134a8b7400abc2ecb4ac075a8cb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:24.081175 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:24.081627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:24.081709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:24.103662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:24.104946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:24.169065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1337/2671] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:38:24.179593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:24.181008 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:24.248777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684e809-0902-4dba-8d3e-4638103db755 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:24.252927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:24.253584 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:24.253871 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:24.254150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:24.264367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:24.265849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:24.275754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1335/2672] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:24.555444 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:24.557231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:24.570769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dca939-f399-4755-a581-e5dd8eb3970a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:24.575911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:24.576863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:24.577167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:24.577442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] PATH_INFO: `/v3/projects/9507ac8c56ba49a69a46c68b157431c7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:24.578716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9507ac8c56ba49a69a46c68b157431c7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:24.580696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:24.588358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:24.632445 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9507ac8c56ba49a69a46c68b157431c7', 'request_id': 'req-b732c1a9-a4df-4963-b484-45852f32b208'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.638667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9507ac8c56ba49a69a46c68b157431c7', 'request_id': 'req-b732c1a9-a4df-4963-b484-45852f32b208'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.644257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9507ac8c56ba49a69a46c68b157431c7', 'request_id': 'req-b732c1a9-a4df-4963-b484-45852f32b208'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.660007 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] The token cache is being invalidate because project 9507ac8c56ba49a69a46c68b157431c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:24.660295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.661275 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.662780 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1338/2673] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:24 2022] DELETE /identity/v3/projects/9507ac8c56ba49a69a46c68b157431c7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:24.667253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:24.678867 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799f03a-5f32-463a-a46a-13db3fb643f4 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:24.702360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:24.743834 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:24.744741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:24.745028 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:24.745300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] PATH_INFO: `/v3/users/6a0b309ba8734dbfb8a475e85c690a9b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:24.746528 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0b309ba8734dbfb8a475e85c690a9b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:24.748560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:24.795260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0b309ba8734dbfb8a475e85c690a9b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.802324 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0b309ba8734dbfb8a475e85c690a9b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.803177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0b309ba8734dbfb8a475e85c690a9b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.804051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0b309ba8734dbfb8a475e85c690a9b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.815699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-89a1e315-1cd1-4ab9-a7f7-08b9e223bc70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0b309ba8734dbfb8a475e85c690a9b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:24.829805 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1336/2674] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:24 2022] DELETE /identity/v3/users/6a0b309ba8734dbfb8a475e85c690a9b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:25.113055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.115413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:25.129333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732c1a9-a4df-4963-b484-45852f32b208 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.189284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.190162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.190440 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.190710 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] PATH_INFO: `/v3/projects/8b12ab1ed5144ed298241a6cdaab989a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.191894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b12ab1ed5144ed298241a6cdaab989a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.193928 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.242096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b12ab1ed5144ed298241a6cdaab989a', 'request_id': 'req-90553c4c-14f9-46a5-b785-5785a8530410'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:25.248568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b12ab1ed5144ed298241a6cdaab989a', 'request_id': 'req-90553c4c-14f9-46a5-b785-5785a8530410'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:25.254479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b12ab1ed5144ed298241a6cdaab989a', 'request_id': 'req-90553c4c-14f9-46a5-b785-5785a8530410'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:25.268496 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] The token cache is being invalidate because project 8b12ab1ed5144ed298241a6cdaab989a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:25.268810 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:25.269458 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-90553c4c-14f9-46a5-b785-5785a8530410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:25.271013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1339/2675] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:25 2022] DELETE /identity/v3/projects/8b12ab1ed5144ed298241a6cdaab989a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:25.276172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17a8c3-1dad-4fd0-9fc5-0ac8a2b45de1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.276686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17a8c3-1dad-4fd0-9fc5-0ac8a2b45de1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.277001 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17a8c3-1dad-4fd0-9fc5-0ac8a2b45de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.294481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9f17a8c3-1dad-4fd0-9fc5-0ac8a2b45de1 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:25.295731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9f17a8c3-1dad-4fd0-9fc5-0ac8a2b45de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:25.355796 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1337/2676] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:38:25.363636 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815fc7-ac32-43dd-a5fc-34294dd6191a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.363927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815fc7-ac32-43dd-a5fc-34294dd6191a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.364208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5815fc7-ac32-43dd-a5fc-34294dd6191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.382512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e5815fc7-ac32-43dd-a5fc-34294dd6191a None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:25.383717 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e5815fc7-ac32-43dd-a5fc-34294dd6191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:25.391880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1340/2677] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:25.396099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17a8c3-1dad-4fd0-9fc5-0ac8a2b45de1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.406181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17a8c3-1dad-4fd0-9fc5-0ac8a2b45de1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.411066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.411720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.412035 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.412483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.413237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:38:25.413550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.415507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.427061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1338/2678] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:38:25.431240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5815fc7-ac32-43dd-a5fc-34294dd6191a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.440638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5815fc7-ac32-43dd-a5fc-34294dd6191a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.445837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.446485 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.446767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.447047 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.447737 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.449676 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.464223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:25.480951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1341/2679] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:25.482302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.492488 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75439b21-24d1-4501-b673-dee19c48189e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.522461 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:25.551032 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.551735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.552012 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.552283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.553200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.555024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.577071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1339/2680] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:25 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:25.581383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.592155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc77d3-3c11-459d-85f6-5ee34550d750 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.597065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.597728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.598011 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.598327 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.599056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.600972 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.611404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1342/2681] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:25.615844 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.625720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91d295-b551-4a0a-a646-5d5a515bec40 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.631193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f52e6-9897-448d-89e1-a22b987e4ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.635053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f52e6-9897-448d-89e1-a22b987e4ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.635330 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f52e6-9897-448d-89e1-a22b987e4ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.635622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f52e6-9897-448d-89e1-a22b987e4ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.636359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f52e6-9897-448d-89e1-a22b987e4ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.638021 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f52e6-9897-448d-89e1-a22b987e4ab3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.648520 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1340/2682] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:25.654692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.671140 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fc40e-31a3-4d0d-989f-19e2d4127701 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.680752 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.681639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.681935 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.682207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] PATH_INFO: `/v3/projects/947eeab15ebd47f6a9fa1c82b41b5199/users/8b1f5e05399b4d9ab8ef570a4d9356f1/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.698611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947eeab15ebd47f6a9fa1c82b41b5199, user_id=8b1f5e05399b4d9ab8ef570a4d9356f1, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.701217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.716190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1343/2683] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:25 2022] PUT /identity/v3/projects/947eeab15ebd47f6a9fa1c82b41b5199/users/8b1f5e05399b4d9ab8ef570a4d9356f1/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:25.727744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d5542-f4a0-4d5a-becd-d8ba8fcd642e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.728031 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d5542-f4a0-4d5a-becd-d8ba8fcd642e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.728314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d5542-f4a0-4d5a-becd-d8ba8fcd642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.757123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f41d5542-f4a0-4d5a-becd-d8ba8fcd642e None None] MFA Rules not processed for user `8b1f5e05399b4d9ab8ef570a4d9356f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:25.758332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f41d5542-f4a0-4d5a-becd-d8ba8fcd642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:25.825332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1341/2684] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:25.837621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:25.839695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:25.897344 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061dcdb-9a6e-48c0-9899-456d5d237977 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:25.901857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b0b9c-f7fc-4aae-98a7-28b10d5b5977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:25.902507 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0b9c-f7fc-4aae-98a7-28b10d5b5977 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:25.902791 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0b9c-f7fc-4aae-98a7-28b10d5b5977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:25.903063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b0b9c-f7fc-4aae-98a7-28b10d5b5977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:25.912054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b0b9c-f7fc-4aae-98a7-28b10d5b5977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:25.913743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b0b9c-f7fc-4aae-98a7-28b10d5b5977 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:25.923401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1344/2685] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:28.485575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d5542-f4a0-4d5a-becd-d8ba8fcd642e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:28.551731 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d5542-f4a0-4d5a-becd-d8ba8fcd642e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:28.557607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:28.558489 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:28.558767 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:28.559052 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] PATH_INFO: `/v3/users/8b1f5e05399b4d9ab8ef570a4d9356f1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:28.560329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1f5e05399b4d9ab8ef570a4d9356f1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:28.562311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:28.614256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:28.622884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1f5e05399b4d9ab8ef570a4d9356f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:28.633562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1f5e05399b4d9ab8ef570a4d9356f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:28.634248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1f5e05399b4d9ab8ef570a4d9356f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:28.634847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1f5e05399b4d9ab8ef570a4d9356f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:28.648111 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1f5e05399b4d9ab8ef570a4d9356f1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:28.661661 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1342/2686] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:28 2022] DELETE /identity/v3/users/8b1f5e05399b4d9ab8ef570a4d9356f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:28.666863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:28.667336 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:28.667430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:28.686339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:28.687281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:28.755797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1345/2687] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:28.768214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:28.769654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:28.831580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c851d2-edb5-40dd-8533-e5a58c6d1e48 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:28.837231 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f671e4-bc2e-4191-bf59-47ec6d18e773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:28.837905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f671e4-bc2e-4191-bf59-47ec6d18e773 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:28.838239 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f671e4-bc2e-4191-bf59-47ec6d18e773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:28.838447 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f671e4-bc2e-4191-bf59-47ec6d18e773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:28.848641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f671e4-bc2e-4191-bf59-47ec6d18e773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:28.850453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f671e4-bc2e-4191-bf59-47ec6d18e773 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:28.863727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1343/2688] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:29.395720 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:29.397558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:29.413540 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f3d11-106a-41f6-9282-6091805bf36e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:29.420880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:29.421912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.422332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.422615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] PATH_INFO: `/v3/projects/947eeab15ebd47f6a9fa1c82b41b5199` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.424000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947eeab15ebd47f6a9fa1c82b41b5199)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:29.426727 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:29.476580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947eeab15ebd47f6a9fa1c82b41b5199', 'request_id': 'req-75f45c1c-2eef-4f6c-8b83-542f55524726'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:29.483536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947eeab15ebd47f6a9fa1c82b41b5199', 'request_id': 'req-75f45c1c-2eef-4f6c-8b83-542f55524726'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:29.487310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:29.490263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947eeab15ebd47f6a9fa1c82b41b5199', 'request_id': 'req-75f45c1c-2eef-4f6c-8b83-542f55524726'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:29.505690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] The token cache is being invalidate because project 947eeab15ebd47f6a9fa1c82b41b5199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:29.505973 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:29.506599 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-75f45c1c-2eef-4f6c-8b83-542f55524726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:29.508241 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1346/2689] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:29 2022] DELETE /identity/v3/projects/947eeab15ebd47f6a9fa1c82b41b5199 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:29.513756 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6a232-dd74-41c8-878e-af86c9049a20 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.514275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6a232-dd74-41c8-878e-af86c9049a20 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.514275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6a232-dd74-41c8-878e-af86c9049a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.532601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-49d6a232-dd74-41c8-878e-af86c9049a20 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:29.534014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-49d6a232-dd74-41c8-878e-af86c9049a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:29.597090 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1344/2690] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:29.605407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124bcdc-2797-4ff5-bdd6-779ce20413b3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.605706 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124bcdc-2797-4ff5-bdd6-779ce20413b3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.605963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124bcdc-2797-4ff5-bdd6-779ce20413b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.625063 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9124bcdc-2797-4ff5-bdd6-779ce20413b3 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:29.626269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9124bcdc-2797-4ff5-bdd6-779ce20413b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:29.634659 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1347/2691] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:29.639306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6a232-dd74-41c8-878e-af86c9049a20 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:29.649172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6a232-dd74-41c8-878e-af86c9049a20 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:29.653725 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:29.654398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.654679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.654966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.655695 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:38:29.656002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:29.657641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:29.670322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1345/2692] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:38:29.674490 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124bcdc-2797-4ff5-bdd6-779ce20413b3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:29.683726 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124bcdc-2797-4ff5-bdd6-779ce20413b3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:29.688885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:29.689536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.689813 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.690080 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.690767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:29.692685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:29.719585 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1348/2693] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:38:29 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:29.723804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:29.734882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56d31d-e430-4faf-913d-1c9e2ec71ecd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:29.782404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:29.798617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:29.799314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.799593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.799863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.800575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:29.802951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:29.829283 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1346/2694] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:29 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:29.830732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:29.843357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343032d-42b7-45c5-945c-1d3622f0c898 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:29.849249 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:29.850757 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.851056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.851341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.852086 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:29.853763 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:29.865665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1349/2695] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:29.870081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:29.881642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a515-56f4-4d06-9b28-dd67cd74d38c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:29.886905 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d1f34-9e65-4e9f-89c7-6cc53a629a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:29.887591 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1f34-9e65-4e9f-89c7-6cc53a629a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.887893 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1f34-9e65-4e9f-89c7-6cc53a629a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.888166 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d1f34-9e65-4e9f-89c7-6cc53a629a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.888943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d1f34-9e65-4e9f-89c7-6cc53a629a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:29.890641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d1f34-9e65-4e9f-89c7-6cc53a629a15 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:29.903148 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1347/2696] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:29.907696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:29.919819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb53d4-55d2-44df-ae13-d23e384556e4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:29.925801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:29.926865 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.927165 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.927427 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] PATH_INFO: `/v3/projects/9f12e79839ad4b68b0f1b1e25e026138/users/98e655e219ec4e0eb6a31495e21b11cd/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:29.944512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f12e79839ad4b68b0f1b1e25e026138, user_id=98e655e219ec4e0eb6a31495e21b11cd, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:29.947206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:29.961520 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1350/2697] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:29 2022] PUT /identity/v3/projects/9f12e79839ad4b68b0f1b1e25e026138/users/98e655e219ec4e0eb6a31495e21b11cd/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:29.971930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82132bbf-d416-47ed-bfe6-0b88741c2047 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:29.972216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82132bbf-d416-47ed-bfe6-0b88741c2047 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:29.972491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82132bbf-d416-47ed-bfe6-0b88741c2047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:30.003497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-82132bbf-d416-47ed-bfe6-0b88741c2047 None None] MFA Rules not processed for user `98e655e219ec4e0eb6a31495e21b11cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:30.004758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-82132bbf-d416-47ed-bfe6-0b88741c2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:30.075970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1348/2698] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:30.088096 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:30.089999 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:30.147460 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46e249-0497-449b-a99c-c98641fbc225 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:30.151081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7c085-b7c3-4b5e-816f-8460c62df897 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:30.151773 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c085-b7c3-4b5e-816f-8460c62df897 service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:30.152054 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c085-b7c3-4b5e-816f-8460c62df897 service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:30.152334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c085-b7c3-4b5e-816f-8460c62df897 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:30.161542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7c085-b7c3-4b5e-816f-8460c62df897 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:30.163019 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7c085-b7c3-4b5e-816f-8460c62df897 service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:30.173029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1351/2699] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:40.072677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:40.168931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:51.819282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82132bbf-d416-47ed-bfe6-0b88741c2047 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:51.886684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82132bbf-d416-47ed-bfe6-0b88741c2047 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:51.891854 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:51.892735 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:51.893222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:51.893494 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] PATH_INFO: `/v3/users/98e655e219ec4e0eb6a31495e21b11cd` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:51.894711 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e655e219ec4e0eb6a31495e21b11cd)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:51.896874 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:51.944628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e655e219ec4e0eb6a31495e21b11cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:51.953479 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e655e219ec4e0eb6a31495e21b11cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:51.954171 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e655e219ec4e0eb6a31495e21b11cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:51.954822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e655e219ec4e0eb6a31495e21b11cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:51.970870 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e655e219ec4e0eb6a31495e21b11cd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:51.987865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1349/2700] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:38:51 2022] DELETE /identity/v3/users/98e655e219ec4e0eb6a31495e21b11cd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:51.992896 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:51.993355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:51.993449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.011884 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:52.013177 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:52.076582 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1352/2701] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:52.093467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:52.095140 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:52.168095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa7f8-2f70-4bb8-aa35-59a033d9eeab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:52.171951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c599caa-c81b-48cc-9427-5123d730063d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:52.172610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599caa-c81b-48cc-9427-5123d730063d service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.172931 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599caa-c81b-48cc-9427-5123d730063d service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.173206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c599caa-c81b-48cc-9427-5123d730063d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.183009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c599caa-c81b-48cc-9427-5123d730063d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:52.184440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c599caa-c81b-48cc-9427-5123d730063d service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:52.195414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1350/2702] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:52.478802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:52.480254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:52.494545 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83e53-5eea-4aa8-a4a2-4fe25e6c2217 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:52.500416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:52.501343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.501618 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.501889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] PATH_INFO: `/v3/projects/9f12e79839ad4b68b0f1b1e25e026138` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.503250 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f12e79839ad4b68b0f1b1e25e026138)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:52.505138 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:52.559907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f12e79839ad4b68b0f1b1e25e026138', 'request_id': 'req-0a689966-c379-4ed0-a820-0b7011be8ec3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:52.566170 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f12e79839ad4b68b0f1b1e25e026138', 'request_id': 'req-0a689966-c379-4ed0-a820-0b7011be8ec3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:52.573629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f12e79839ad4b68b0f1b1e25e026138', 'request_id': 'req-0a689966-c379-4ed0-a820-0b7011be8ec3'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:52.586078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] The token cache is being invalidate because project 9f12e79839ad4b68b0f1b1e25e026138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:38:52.586453 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:52.587069 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0a689966-c379-4ed0-a820-0b7011be8ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:38:52.588629 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1353/2703] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:38:52 2022] DELETE /identity/v3/projects/9f12e79839ad4b68b0f1b1e25e026138 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:38:52.594219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a9250-d558-46d3-bb0d-0217180153af None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.594449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a9250-d558-46d3-bb0d-0217180153af None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.594724 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a9250-d558-46d3-bb0d-0217180153af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.612071 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-168a9250-d558-46d3-bb0d-0217180153af None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:52.613302 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-168a9250-d558-46d3-bb0d-0217180153af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:52.631751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:52.679617 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1351/2704] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:52.691227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3ce7c-ceaa-49b2-9cfc-d361d152fa0c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.691607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3ce7c-ceaa-49b2-9cfc-d361d152fa0c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.692064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3ce7c-ceaa-49b2-9cfc-d361d152fa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.713970 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-72b3ce7c-ceaa-49b2-9cfc-d361d152fa0c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:52.715471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-72b3ce7c-ceaa-49b2-9cfc-d361d152fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:52.724113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1354/2705] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:52.730694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a9250-d558-46d3-bb0d-0217180153af None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:52.745094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a9250-d558-46d3-bb0d-0217180153af None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:52.751014 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:52.751674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.751952 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.752221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.752957 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:38:52.753259 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:52.754891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:52.767438 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1352/2706] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:38:52.771803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3ce7c-ceaa-49b2-9cfc-d361d152fa0c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:52.781833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3ce7c-ceaa-49b2-9cfc-d361d152fa0c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:52.786922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:52.787568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.787844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.788113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.788841 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:52.791268 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:52.819807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1355/2707] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:38:52 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:38:52.824322 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:52.834626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29a539-fba6-4908-8a4a-f307a00561b8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:52.897676 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:52.898766 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.899160 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.899562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.900567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:52.903576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:52.934709 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1353/2708] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:38:52 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:38:52.939398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:52.952698 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e1d5c-28b2-41e7-bd1b-23aa39acf135 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:52.958059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:52.958748 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.959029 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.959305 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.960015 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:52.961784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:52.972279 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1356/2709] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:52.976293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:52.986768 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40297cc1-daed-46d7-ab12-284ca5b44335 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:52.991720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7ba3b-c698-44d9-af6d-2d7c3cc02971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:52.992388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7ba3b-c698-44d9-af6d-2d7c3cc02971 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:52.992692 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7ba3b-c698-44d9-af6d-2d7c3cc02971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:52.992996 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7ba3b-c698-44d9-af6d-2d7c3cc02971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:52.993745 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7ba3b-c698-44d9-af6d-2d7c3cc02971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:52.995354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7ba3b-c698-44d9-af6d-2d7c3cc02971 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:53.005682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1354/2710] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:38:53.011703 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:53.027569 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a6bbb-181f-480a-97f0-428f855ac02f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:53.036499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:53.037774 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:53.038056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:53.038347 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] PATH_INFO: `/v3/projects/f8258198359b4bb481136d1fc9c7d8b7/users/9560fe40800045b5b9e0efbb237bea63/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:53.055821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8258198359b4bb481136d1fc9c7d8b7, user_id=9560fe40800045b5b9e0efbb237bea63, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:53.058552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:53.075512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1357/2711] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:38:53 2022] PUT /identity/v3/projects/f8258198359b4bb481136d1fc9c7d8b7/users/9560fe40800045b5b9e0efbb237bea63/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:38:53.086061 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87e41-9641-4aad-bc0f-7718160fbeed None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:53.086471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87e41-9641-4aad-bc0f-7718160fbeed None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:53.086780 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf87e41-9641-4aad-bc0f-7718160fbeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:53.114853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7cf87e41-9641-4aad-bc0f-7718160fbeed None None] MFA Rules not processed for user `9560fe40800045b5b9e0efbb237bea63`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:53.116654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7cf87e41-9641-4aad-bc0f-7718160fbeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:53.190802 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1355/2712] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:38:53.201732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:38:53.203577 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:53.226923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:53.266143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1767c2-a576-4d83-bdc3-f9c6ac694386 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:38:53.270480 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f18555-8f48-41bc-b840-caf8f958e1cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:38:53.271135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18555-8f48-41bc-b840-caf8f958e1cf service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:53.271448 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18555-8f48-41bc-b840-caf8f958e1cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:53.271732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18555-8f48-41bc-b840-caf8f958e1cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:53.284107 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f18555-8f48-41bc-b840-caf8f958e1cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:38:53.285907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f18555-8f48-41bc-b840-caf8f958e1cf service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:38:53.300325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1358/2713] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:38:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:38:54.675256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:38:54.675799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:38:54.675799 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:38:54.694995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] MFA Rules not processed for user `9560fe40800045b5b9e0efbb237bea63`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:38:54.696215 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:38:54.704778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1356/2714] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:38:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:39:03.294044 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=17 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:39:04.689314 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:39:08.378966 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103452-e604-4a99-ae42-bb8dd712fdf9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:08.379517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103452-e604-4a99-ae42-bb8dd712fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:08.379517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc103452-e604-4a99-ae42-bb8dd712fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:08.398406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bc103452-e604-4a99-ae42-bb8dd712fdf9 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:39:08.399527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc103452-e604-4a99-ae42-bb8dd712fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:08.461472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1359/2715] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:39:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:39:08.513618 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:08.515093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:08.586051 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6ca9b-9473-4c8a-bdcb-d6dd40dc98ac None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:08.591646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:08.592298 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:08.592574 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:08.592889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:08.601280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:08.602865 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:08.611981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1357/2716] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:39:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:39:09.212640 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4876b-ca02-4a34-a0c6-985e958763e3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:09.212962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4876b-ca02-4a34-a0c6-985e958763e3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:09.213243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4876b-ca02-4a34-a0c6-985e958763e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:09.232630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5ba4876b-ca02-4a34-a0c6-985e958763e3 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:39:09.234239 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5ba4876b-ca02-4a34-a0c6-985e958763e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:09.243548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1360/2717] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jun 23 11:39:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:39:09.256334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:09.268544 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d7e71-c31b-4cfb-beac-ec845870cdee service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:09.274074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:09.274815 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:09.275104 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:09.275399 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:09.286290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:09.287962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:09.297763 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1358/2718] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:39:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:39:09.502554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae922c-a7c5-4ae7-8fb2-8b9bcbd8fd00 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:09.503060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae922c-a7c5-4ae7-8fb2-8b9bcbd8fd00 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:09.503060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae922c-a7c5-4ae7-8fb2-8b9bcbd8fd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:09.521462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e0ae922c-a7c5-4ae7-8fb2-8b9bcbd8fd00 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:39:09.522787 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e0ae922c-a7c5-4ae7-8fb2-8b9bcbd8fd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:09.530442 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1361/2719] 10.222.0.66 () {58 vars in 1009 bytes} [Thu Jun 23 11:39:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:39:09.543043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:09.553951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1639e-7c98-485e-841f-9c173decb0f9 service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:09.559064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:09.559727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:09.560018 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:09.560316 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:09.569161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:09.570764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:09.580909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1359/2720] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:39:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:39:09.926724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba45ce-7127-419f-ac79-1b11a752bca3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:09.927210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba45ce-7127-419f-ac79-1b11a752bca3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:09.927513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba45ce-7127-419f-ac79-1b11a752bca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:09.945989 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1dba45ce-7127-419f-ac79-1b11a752bca3 None None] MFA Rules not processed for user `f47acd9b12ef428c941175dd18ca3029`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:39:09.947196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1dba45ce-7127-419f-ac79-1b11a752bca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:09.955134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1362/2721] 10.222.0.66 () {58 vars in 967 bytes} [Thu Jun 23 11:39:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:39:09.967335 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:09.978470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d6239-69fb-4658-baa7-f09272c39239 service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:09.984409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a2a5-5746-4fea-8f62-3181e5456a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '954ff9ef0bd54012af73a0b901a7893b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:09.985108 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a2a5-5746-4fea-8f62-3181e5456a72 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:09.985419 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a2a5-5746-4fea-8f62-3181e5456a72 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:09.985680 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a2a5-5746-4fea-8f62-3181e5456a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:09.994195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a2a5-5746-4fea-8f62-3181e5456a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:09.995788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a2a5-5746-4fea-8f62-3181e5456a72 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:10.003860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1360/2722] 10.222.0.66 () {60 vars in 1384 bytes} [Thu Jun 23 11:39:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:39:12.128424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba45ce-7127-419f-ac79-1b11a752bca3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:12.196676 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba45ce-7127-419f-ac79-1b11a752bca3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:12.202597 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:12.203524 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:12.203801 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:12.204103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] PATH_INFO: `/v3/users/9560fe40800045b5b9e0efbb237bea63` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:12.205497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9560fe40800045b5b9e0efbb237bea63)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:12.207463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:12.259807 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9560fe40800045b5b9e0efbb237bea63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.272041 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9560fe40800045b5b9e0efbb237bea63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.272820 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9560fe40800045b5b9e0efbb237bea63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.273421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9560fe40800045b5b9e0efbb237bea63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.287223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9560fe40800045b5b9e0efbb237bea63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.303306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1363/2723] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:39:12 2022] DELETE /identity/v3/users/9560fe40800045b5b9e0efbb237bea63 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:39:12.307926 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:12.308423 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:12.308538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:12.327085 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:39:12.328292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:12.389856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1361/2724] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:39:12.400845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:12.402357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:12.410233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:39:12.484738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cd0b2-c435-44d7-8d58-5c018bb9b7dc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:12.488628 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfa0cf-4cb7-4c2a-941e-86700d8d51e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:12.489326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfa0cf-4cb7-4c2a-941e-86700d8d51e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:12.489605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfa0cf-4cb7-4c2a-941e-86700d8d51e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:12.489876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfa0cf-4cb7-4c2a-941e-86700d8d51e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:12.499346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfa0cf-4cb7-4c2a-941e-86700d8d51e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:12.500809 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfa0cf-4cb7-4c2a-941e-86700d8d51e2 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:12.511073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1364/2725] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:39:12.694598 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:12.696174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:12.709497 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e3dc8-eb24-4994-abcc-3ef0286274d6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:12.714811 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:12.715702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:12.716206 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:12.716818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] PATH_INFO: `/v3/projects/f8258198359b4bb481136d1fc9c7d8b7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:12.718000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8258198359b4bb481136d1fc9c7d8b7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:12.719943 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:12.772228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:39:12.776469 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8258198359b4bb481136d1fc9c7d8b7', 'request_id': 'req-e1ac5db3-3a07-4117-a2f2-71db6ee25992'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.791742 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8258198359b4bb481136d1fc9c7d8b7', 'request_id': 'req-e1ac5db3-3a07-4117-a2f2-71db6ee25992'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.802754 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8258198359b4bb481136d1fc9c7d8b7', 'request_id': 'req-e1ac5db3-3a07-4117-a2f2-71db6ee25992'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.815741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] The token cache is being invalidate because project f8258198359b4bb481136d1fc9c7d8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:39:12.816019 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.816764 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:39:12.818939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1362/2726] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:39:12 2022] DELETE /identity/v3/projects/f8258198359b4bb481136d1fc9c7d8b7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:39:17.918467 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87232-0aa5-4f2a-a183-eabd94867be3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:17.919431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87232-0aa5-4f2a-a183-eabd94867be3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:17.919431 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab87232-0aa5-4f2a-a183-eabd94867be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:17.938770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0ab87232-0aa5-4f2a-a183-eabd94867be3 None None] MFA Rules not processed for user `a37f2a1caf4c483095c5927885e9f8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:39:17.939984 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0ab87232-0aa5-4f2a-a183-eabd94867be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:18.000655 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1365/2727] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:39:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:39:22.812376 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:39:27.991313 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=49 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:39:52.284706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:39:52.286306 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:52.370094 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac5db3-3a07-4117-a2f2-71db6ee25992 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:39:52.376005 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:39:52.376654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:39:52.376961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:39:52.377233 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:39:52.379809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:39:52.391478 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:39:52.393086 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:39:52.403847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1363/2728] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:39:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:40:02.399585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=32 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:40:16.967607 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:40:16.968121 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:40:16.968232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:40:16.991320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] MFA Rules not processed for user `a37f2a1caf4c483095c5927885e9f8d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:40:16.992546 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:40:17.003396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1366/2729] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:40:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:40:17.345751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:40:17.347363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:40:17.407848 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1899e-fc84-4c0f-b277-374761b30653 service placement] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:40:17.412185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:40:17.412875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:40:17.413161 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:40:17.413441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:40:17.415421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:40:17.425982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:40:17.427426 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:40:17.436587 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1364/2730] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:40:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:40:26.985670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:40:27.432081 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=26 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:16.230025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:16.232802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:16.248857 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4034b-6458-46e4-96a9-b48ff8874d75 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:16.254284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:16.255018 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:16.255364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:16.255701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:16.257634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:16.270294 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:16.272133 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:16.284945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1367/2731] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:16.304181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:16.306241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:16.391934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f134c-ed9e-452c-8649-b2881bab44b0 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:16.396743 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:16.397663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:16.397945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:16.398248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] PATH_INFO: `/v3/users/a37f2a1caf4c483095c5927885e9f8d2` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:16.399486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37f2a1caf4c483095c5927885e9f8d2)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:16.401653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:16.452358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37f2a1caf4c483095c5927885e9f8d2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.459055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37f2a1caf4c483095c5927885e9f8d2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.459713 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37f2a1caf4c483095c5927885e9f8d2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.460309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37f2a1caf4c483095c5927885e9f8d2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.473572 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-672d8e41-0c83-4689-9037-e62455caca4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37f2a1caf4c483095c5927885e9f8d2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.488493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1365/2732] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:16 2022] DELETE /identity/v3/users/a37f2a1caf4c483095c5927885e9f8d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:16.667264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:16.678969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba90d-113d-44e6-9dbc-556bde85e141 service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:16.740934 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:16.741818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:16.742095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:16.743808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] PATH_INFO: `/v3/projects/499b1def7bc14c4c9143af0f34b2be9e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:16.745058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499b1def7bc14c4c9143af0f34b2be9e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:16.747771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:16.811957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499b1def7bc14c4c9143af0f34b2be9e', 'request_id': 'req-d713955f-4c81-40bb-86a0-696c50233842'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.818559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499b1def7bc14c4c9143af0f34b2be9e', 'request_id': 'req-d713955f-4c81-40bb-86a0-696c50233842'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.824656 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499b1def7bc14c4c9143af0f34b2be9e', 'request_id': 'req-d713955f-4c81-40bb-86a0-696c50233842'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.839514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] The token cache is being invalidate because project 499b1def7bc14c4c9143af0f34b2be9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:16.839755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.840990 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d713955f-4c81-40bb-86a0-696c50233842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:16.842660 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1368/2733] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:16 2022] DELETE /identity/v3/projects/499b1def7bc14c4c9143af0f34b2be9e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:16.847777 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3951a2-5d68-46f8-8c59-5d56d270f81d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:16.848066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3951a2-5d68-46f8-8c59-5d56d270f81d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:16.848339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3951a2-5d68-46f8-8c59-5d56d270f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:16.866486 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8b3951a2-5d68-46f8-8c59-5d56d270f81d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:16.867705 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8b3951a2-5d68-46f8-8c59-5d56d270f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:16.930144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1366/2734] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:16.938871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5ef9-3b26-4088-9c37-d0f4146c3b97 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:16.939383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5ef9-3b26-4088-9c37-d0f4146c3b97 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:16.939716 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db5ef9-3b26-4088-9c37-d0f4146c3b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:16.961113 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-48db5ef9-3b26-4088-9c37-d0f4146c3b97 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:16.962320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-48db5ef9-3b26-4088-9c37-d0f4146c3b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:16.971421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1369/2735] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:16.975881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3951a2-5d68-46f8-8c59-5d56d270f81d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:16.985901 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3951a2-5d68-46f8-8c59-5d56d270f81d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:16.991332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:16.992041 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:16.992769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:16.992769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:16.993773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:41:16.994058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:16.995710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.009441 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1367/2736] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:41:17.014360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db5ef9-3b26-4088-9c37-d0f4146c3b97 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.024246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db5ef9-3b26-4088-9c37-d0f4146c3b97 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.029579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.034420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.034701 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.035001 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.036400 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.040024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.077340 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1370/2737] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:17 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:17.081332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.092403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb248b2-54a6-4a7a-b448-745b2f3a7f0c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.096228 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:17.154412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.155102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.155387 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.155667 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.156388 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.158348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.182994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1368/2738] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:17 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:41:17.188220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.200192 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68da5d-4298-4b55-ac76-7851e32065ae admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.205786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.206465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.206747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.207004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.207739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.209401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.220881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1371/2739] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:17.225135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.235988 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7fbff-50c9-4dcc-9094-aff00caf8f86 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.241631 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db86b9a-c837-4282-82ee-b5efd4b48ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.242315 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db86b9a-c837-4282-82ee-b5efd4b48ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.242600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db86b9a-c837-4282-82ee-b5efd4b48ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.242877 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db86b9a-c837-4282-82ee-b5efd4b48ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.243607 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db86b9a-c837-4282-82ee-b5efd4b48ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.245260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db86b9a-c837-4282-82ee-b5efd4b48ab8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.256095 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1369/2740] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:17.260119 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.270750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b7c6c-8335-45a8-b69b-c7b90b2212c1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.275711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.276594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.277057 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.277359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] PATH_INFO: `/v3/projects/33208af27ea8422d9049933115d11582/users/d3d9a8a988e74338bfbbe79058da33c4/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.292548 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33208af27ea8422d9049933115d11582, user_id=d3d9a8a988e74338bfbbe79058da33c4, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.295406 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.311306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1372/2741] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:17 2022] PUT /identity/v3/projects/33208af27ea8422d9049933115d11582/users/d3d9a8a988e74338bfbbe79058da33c4/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:41:17.326642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139f6d-9156-4b47-be79-3a210e62c4fc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.327145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139f6d-9156-4b47-be79-3a210e62c4fc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.327145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139f6d-9156-4b47-be79-3a210e62c4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.358545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3c139f6d-9156-4b47-be79-3a210e62c4fc None None] MFA Rules not processed for user `d3d9a8a988e74338bfbbe79058da33c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:17.359706 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3c139f6d-9156-4b47-be79-3a210e62c4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:17.441471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1370/2742] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:17.446330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.463741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:17.517117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5802a7-b608-41cb-90ef-0d8bf97bf2f9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.523009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.523670 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.523944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.524215 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.524919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.526818 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.553922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1373/2743] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:17 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:17.559916 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139f6d-9156-4b47-be79-3a210e62c4fc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.571118 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139f6d-9156-4b47-be79-3a210e62c4fc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.631355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.631973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.632252 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.632530 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.633253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.635175 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.656622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1371/2744] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:17 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:17.661082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.671846 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc9512-9487-45f7-92b4-e8a3c43ebb8e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.676977 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.677637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.677927 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.678196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.678925 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.680517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.691630 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1374/2745] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:17.696353 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.707407 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:17.713165 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c41d-5062-499e-a5a0-b320e32d2435 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.719575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.720460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.720747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.722788 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] PATH_INFO: `/v3/projects/b698389ce6ef48d5b8717ff2add6a8b9/users/f0038558c0dc4d6ea2988c8b35a52870/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.737611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b698389ce6ef48d5b8717ff2add6a8b9, user_id=f0038558c0dc4d6ea2988c8b35a52870, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.740273 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.753145 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1372/2746] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:17 2022] PUT /identity/v3/projects/b698389ce6ef48d5b8717ff2add6a8b9/users/f0038558c0dc4d6ea2988c8b35a52870/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:17.757195 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.767583 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b43a2-f7b9-4c5f-86f5-a7455e632261 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.829276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30eb304-e464-4368-bf0f-781a6bf5dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.829951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb304-e464-4368-bf0f-781a6bf5dd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.830236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb304-e464-4368-bf0f-781a6bf5dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.830510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30eb304-e464-4368-bf0f-781a6bf5dd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.831234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eb304-e464-4368-bf0f-781a6bf5dd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.832864 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30eb304-e464-4368-bf0f-781a6bf5dd22 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.843430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1375/2747] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:17.847832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:17.859456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74917-db5a-433a-8d4a-086d0135f77f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:17.865187 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:17.866080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.866367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.866644 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] PATH_INFO: `/v3/projects/b698389ce6ef48d5b8717ff2add6a8b9/users/f0038558c0dc4d6ea2988c8b35a52870/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.868847 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b698389ce6ef48d5b8717ff2add6a8b9, user_id=f0038558c0dc4d6ea2988c8b35a52870, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:17.871646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:17.883475 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1373/2748] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:17 2022] PUT /identity/v3/projects/b698389ce6ef48d5b8717ff2add6a8b9/users/f0038558c0dc4d6ea2988c8b35a52870/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:17.895513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c0a0-3931-4328-b77b-5ddd7087160e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:17.895805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c0a0-3931-4328-b77b-5ddd7087160e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:17.896091 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c0a0-3931-4328-b77b-5ddd7087160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:17.924169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6bf3c0a0-3931-4328-b77b-5ddd7087160e None None] MFA Rules not processed for user `f0038558c0dc4d6ea2988c8b35a52870`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:17.925443 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6bf3c0a0-3931-4328-b77b-5ddd7087160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:17.994620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1376/2749] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:18.005933 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:18.008040 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:18.075995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d40578-a438-4b24-9085-6ff87c35e26d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:18.080269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bb808-72f9-423a-b23b-21a45ece0620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:18.080974 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bb808-72f9-423a-b23b-21a45ece0620 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:18.081255 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bb808-72f9-423a-b23b-21a45ece0620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:18.081531 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bb808-72f9-423a-b23b-21a45ece0620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:18.091247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bb808-72f9-423a-b23b-21a45ece0620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:18.092864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bb808-72f9-423a-b23b-21a45ece0620 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:18.103558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1374/2750] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:18.255483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c0a0-3931-4328-b77b-5ddd7087160e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:18.266405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:18.325193 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c0a0-3931-4328-b77b-5ddd7087160e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:18.332420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:18.333381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:18.334767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:18.334767 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] PATH_INFO: `/v3/users/d3d9a8a988e74338bfbbe79058da33c4` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:18.335290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d9a8a988e74338bfbbe79058da33c4)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:18.337278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:18.399579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d9a8a988e74338bfbbe79058da33c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:18.407874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d9a8a988e74338bfbbe79058da33c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:18.409076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d9a8a988e74338bfbbe79058da33c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:18.409731 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d9a8a988e74338bfbbe79058da33c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:18.425062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d9a8a988e74338bfbbe79058da33c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:18.442169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1377/2751] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:18 2022] DELETE /identity/v3/users/d3d9a8a988e74338bfbbe79058da33c4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:18.446846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:18.447334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:18.447454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:18.471276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:18.474784 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:18.542366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1375/2752] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:18.555802 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:18.557590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:18.636488 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b898f-e1bb-4361-b983-2725d22ab4e3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:18.642031 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:18.643156 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:18.643429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:18.643700 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:18.655360 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:18.656751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:18.670292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1378/2753] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:18.985795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:18.987951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:19.003769 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4929552-53b2-4047-81ab-225301b62e5d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:19.010556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:19.011540 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:19.011887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:19.012232 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] PATH_INFO: `/v3/projects/33208af27ea8422d9049933115d11582` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:19.014325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33208af27ea8422d9049933115d11582)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:19.016561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:19.071459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33208af27ea8422d9049933115d11582', 'request_id': 'req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.079152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33208af27ea8422d9049933115d11582', 'request_id': 'req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.087332 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33208af27ea8422d9049933115d11582', 'request_id': 'req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.093567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:19.102056 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] The token cache is being invalidate because project 33208af27ea8422d9049933115d11582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:19.102465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.103576 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.105339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1376/2754] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:18 2022] DELETE /identity/v3/projects/33208af27ea8422d9049933115d11582 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:19.109613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:19.119708 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34162e-3497-4691-a6ae-6640ab32762f service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:19.171287 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:19.201907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:19.202797 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:19.203081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:19.203355 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] PATH_INFO: `/v3/users/f0038558c0dc4d6ea2988c8b35a52870` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:19.204555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0038558c0dc4d6ea2988c8b35a52870)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:19.206514 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:19.265125 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0038558c0dc4d6ea2988c8b35a52870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.272244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0038558c0dc4d6ea2988c8b35a52870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.272992 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0038558c0dc4d6ea2988c8b35a52870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.273664 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0038558c0dc4d6ea2988c8b35a52870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.286333 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9755eee6-df2d-471c-88f5-021630bcc213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0038558c0dc4d6ea2988c8b35a52870'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.300918 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1379/2755] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:19 2022] DELETE /identity/v3/users/f0038558c0dc4d6ea2988c8b35a52870 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:19.605282 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:19.606949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:19.624571 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f13400-a5e6-4c6b-90b7-c72646cc3f57 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:19.688398 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:19.689329 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:19.689612 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:19.689891 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] PATH_INFO: `/v3/projects/b698389ce6ef48d5b8717ff2add6a8b9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:19.691207 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b698389ce6ef48d5b8717ff2add6a8b9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:19.693177 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:19.755514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b698389ce6ef48d5b8717ff2add6a8b9', 'request_id': 'req-f433c203-c9dc-495f-9bae-595aeb70c084'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.761889 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b698389ce6ef48d5b8717ff2add6a8b9', 'request_id': 'req-f433c203-c9dc-495f-9bae-595aeb70c084'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.770072 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b698389ce6ef48d5b8717ff2add6a8b9', 'request_id': 'req-f433c203-c9dc-495f-9bae-595aeb70c084'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.781075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] The token cache is being invalidate because project b698389ce6ef48d5b8717ff2add6a8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:19.781364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.782023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f433c203-c9dc-495f-9bae-595aeb70c084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:19.783995 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1377/2756] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:19 2022] DELETE /identity/v3/projects/b698389ce6ef48d5b8717ff2add6a8b9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:19.789171 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c6ac-a0aa-41ee-b3b9-8dcc698e1470 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:19.789459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c6ac-a0aa-41ee-b3b9-8dcc698e1470 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:19.789732 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c6ac-a0aa-41ee-b3b9-8dcc698e1470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:19.808483 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5cc6c6ac-a0aa-41ee-b3b9-8dcc698e1470 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:19.809825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5cc6c6ac-a0aa-41ee-b3b9-8dcc698e1470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:19.869242 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1380/2757] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:41:19.879037 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1876e-67ac-48a5-b957-58a3d89d07cf None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:19.879319 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1876e-67ac-48a5-b957-58a3d89d07cf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:19.879592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1876e-67ac-48a5-b957-58a3d89d07cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:19.899257 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c7f1876e-67ac-48a5-b957-58a3d89d07cf None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:19.900456 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c7f1876e-67ac-48a5-b957-58a3d89d07cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:19.911659 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1378/2758] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:19.918100 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c6ac-a0aa-41ee-b3b9-8dcc698e1470 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:19.931339 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c6ac-a0aa-41ee-b3b9-8dcc698e1470 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:19.937099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:19.937873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:19.938081 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:19.938346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:19.939146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:41:19.939479 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:19.941494 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:19.953862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1381/2759] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:41:19.958465 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1876e-67ac-48a5-b957-58a3d89d07cf None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:19.968235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1876e-67ac-48a5-b957-58a3d89d07cf None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:19.974002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:19.974663 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:19.974946 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:19.975221 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:19.975919 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:19.977878 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.010551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1379/2760] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:19 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:20.015087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.029871 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c0e3f-7c08-42d2-be82-1a9d1fd18cc1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.069073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:20.093711 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.094381 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.094637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.094929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.095604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.097615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.117246 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1382/2761] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:20 2022] POST /identity/v3/users => generated 279 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:20.121563 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.132020 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ffa7a-a17f-4c0f-b42a-daa3ba1e995b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.136746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.137431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.137707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.137958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.138795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.140363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.152653 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1380/2762] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:20.157523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.172369 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12edaa7-61d3-4d04-b190-af5307204610 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.178284 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558c226-87db-408f-8eac-96bdffc3383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.178944 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558c226-87db-408f-8eac-96bdffc3383f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.179227 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558c226-87db-408f-8eac-96bdffc3383f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.179500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558c226-87db-408f-8eac-96bdffc3383f admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.180224 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558c226-87db-408f-8eac-96bdffc3383f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.181853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558c226-87db-408f-8eac-96bdffc3383f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.192332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1383/2763] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:20.196326 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.206710 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f190c-f8b9-4ccb-866d-cfe685fa2d22 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.211467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.212346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.212619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.212921 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] PATH_INFO: `/v3/projects/03ed1af3e4054b3aaae4be21f781c1b7/users/22965712b7d74a5da96c182bc0b254f3/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.228909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ed1af3e4054b3aaae4be21f781c1b7, user_id=22965712b7d74a5da96c182bc0b254f3, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.231539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.246262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1381/2764] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:20 2022] PUT /identity/v3/projects/03ed1af3e4054b3aaae4be21f781c1b7/users/22965712b7d74a5da96c182bc0b254f3/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:41:20.256940 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84842b75-cc86-4659-ba2f-7110f67f6661 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.257231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84842b75-cc86-4659-ba2f-7110f67f6661 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.257509 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84842b75-cc86-4659-ba2f-7110f67f6661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.286330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-84842b75-cc86-4659-ba2f-7110f67f6661 None None] MFA Rules not processed for user `22965712b7d74a5da96c182bc0b254f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:20.287473 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-84842b75-cc86-4659-ba2f-7110f67f6661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:20.359808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1384/2765] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:20.364573 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.387346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:20.434198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eb2c4-9fe4-4abd-bbb1-301b04533182 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.440360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.441080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.441365 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.441638 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.442327 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.444263 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.472910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1382/2766] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:20 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:20.477237 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84842b75-cc86-4659-ba2f-7110f67f6661 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.488868 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84842b75-cc86-4659-ba2f-7110f67f6661 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.549783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.550404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.550684 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.550969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.551633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.553558 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.575677 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1385/2767] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:20 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:20.580287 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.591260 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d1609-cb51-40ae-8ebe-821fe23bc564 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.596495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.597203 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.597482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.597762 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.598515 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.600123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.610976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1383/2768] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:20.615232 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.625921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5617a38-7ef0-42b8-bcf8-268e1f53405d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.630761 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.631637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.631911 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.632150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] PATH_INFO: `/v3/projects/b3da1d6ca36e4cbdbe5509c979d537be/users/10b96ed439f54be8998cc079f852d3af/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.647269 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3da1d6ca36e4cbdbe5509c979d537be, user_id=10b96ed439f54be8998cc079f852d3af, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.650048 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.665398 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1386/2769] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:20 2022] PUT /identity/v3/projects/b3da1d6ca36e4cbdbe5509c979d537be/users/10b96ed439f54be8998cc079f852d3af/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:41:20.670689 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.681381 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791f80-4136-4d23-ac51-46716e1c4ce5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.743297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93e2e5-69c3-40b0-9477-1d5f8389ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.743962 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e2e5-69c3-40b0-9477-1d5f8389ae85 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.744241 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e2e5-69c3-40b0-9477-1d5f8389ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.744510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e2e5-69c3-40b0-9477-1d5f8389ae85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.745360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93e2e5-69c3-40b0-9477-1d5f8389ae85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.747053 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93e2e5-69c3-40b0-9477-1d5f8389ae85 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.757990 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1384/2770] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:41:20.762469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.773602 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f721b-c2d7-4d0a-98f4-3f2a27f203db admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.778872 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.779756 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.780062 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.780332 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] PATH_INFO: `/v3/projects/b3da1d6ca36e4cbdbe5509c979d537be/users/10b96ed439f54be8998cc079f852d3af/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.782722 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3da1d6ca36e4cbdbe5509c979d537be, user_id=10b96ed439f54be8998cc079f852d3af, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:20.785778 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:20.791845 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:20.798575 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1387/2771] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:20 2022] PUT /identity/v3/projects/b3da1d6ca36e4cbdbe5509c979d537be/users/10b96ed439f54be8998cc079f852d3af/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:20.810066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee0daa-7515-41ff-8de9-303cecf6c7cc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.810291 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee0daa-7515-41ff-8de9-303cecf6c7cc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.810599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee0daa-7515-41ff-8de9-303cecf6c7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:20.839364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6cee0daa-7515-41ff-8de9-303cecf6c7cc None None] MFA Rules not processed for user `10b96ed439f54be8998cc079f852d3af`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:20.840588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6cee0daa-7515-41ff-8de9-303cecf6c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:20.910178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1385/2772] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:20.921678 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:20.923595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:20.985686 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7dffc-3f33-4ab9-b1ce-53e20dfb7ddf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:20.990094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:20.990755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:20.991035 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:20.991308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:21.000943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:21.002366 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:21.012212 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1388/2773] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:21.090211 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee0daa-7515-41ff-8de9-303cecf6c7cc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:21.100822 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee0daa-7515-41ff-8de9-303cecf6c7cc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:21.104950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:21.105600 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:21.105882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:21.106154 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:21.119024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:21.165792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:21.167244 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:21.179367 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1386/2774] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:28.616231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:28.625900 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:28.715610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9eb2b0-c5b0-482a-916a-9935103b2874 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:28.721017 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:28.721675 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:28.721957 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:28.722234 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:28.724034 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:28.736951 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:28.738610 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:28.749981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1389/2775] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:41:31.172616 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=21 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:31.899470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:31.900969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:31.967752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29c61f-40d3-4e5f-884f-8ca11acd6e50 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:31.972780 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:31.973704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:31.973991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:31.974269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] PATH_INFO: `/v3/users/d45ceae3a93b40fb9770ea8c74607815` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:31.977704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45ceae3a93b40fb9770ea8c74607815)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:31.979650 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:32.039153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45ceae3a93b40fb9770ea8c74607815'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.047797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45ceae3a93b40fb9770ea8c74607815'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.048543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45ceae3a93b40fb9770ea8c74607815'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.049224 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45ceae3a93b40fb9770ea8c74607815'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.064499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45ceae3a93b40fb9770ea8c74607815'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.079812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1387/2776] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:31 2022] DELETE /identity/v3/users/d45ceae3a93b40fb9770ea8c74607815 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:32.273739 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:32.285233 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bd0f6-b8e4-4cdb-b70f-e5990c8bb37a service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:32.354320 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:32.355217 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:32.355499 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:32.355771 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] PATH_INFO: `/v3/projects/254b2e95839d421ca6f90e75b2df1ac2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:32.357082 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=254b2e95839d421ca6f90e75b2df1ac2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:32.360064 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:32.406542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:32.419904 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254b2e95839d421ca6f90e75b2df1ac2', 'request_id': 'req-cac28cf8-7db6-43a9-bdef-e1462d0225f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.426832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254b2e95839d421ca6f90e75b2df1ac2', 'request_id': 'req-cac28cf8-7db6-43a9-bdef-e1462d0225f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.432738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254b2e95839d421ca6f90e75b2df1ac2', 'request_id': 'req-cac28cf8-7db6-43a9-bdef-e1462d0225f9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.447653 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] The token cache is being invalidate because project 254b2e95839d421ca6f90e75b2df1ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:32.447950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.448681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.450390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1390/2777] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:32 2022] DELETE /identity/v3/projects/254b2e95839d421ca6f90e75b2df1ac2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:32.455144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:32.456633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:32.470213 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153450-f497-45b7-91e2-f39ea827f18c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:32.540491 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:32.541732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:32.542073 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:32.542418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] PATH_INFO: `/v3/users/dd9c8a7b42ca41e6a0345a3a1ecfa635` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:32.544386 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9c8a7b42ca41e6a0345a3a1ecfa635)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:32.547492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:32.573482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:32.600775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9c8a7b42ca41e6a0345a3a1ecfa635'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.607551 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9c8a7b42ca41e6a0345a3a1ecfa635'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.608204 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9c8a7b42ca41e6a0345a3a1ecfa635'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.608909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9c8a7b42ca41e6a0345a3a1ecfa635'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.621421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9c8a7b42ca41e6a0345a3a1ecfa635'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.636568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1388/2778] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:32 2022] DELETE /identity/v3/users/dd9c8a7b42ca41e6a0345a3a1ecfa635 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:32.841633 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:32.843093 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:32.856765 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac28cf8-7db6-43a9-bdef-e1462d0225f9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:32.916983 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:32.917861 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:32.918146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:32.918424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] PATH_INFO: `/v3/projects/91a59ba9e8b044beb0f0fef7e1143e71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:32.919675 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a59ba9e8b044beb0f0fef7e1143e71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:32.921724 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:32.971357 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a59ba9e8b044beb0f0fef7e1143e71', 'request_id': 'req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.977931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a59ba9e8b044beb0f0fef7e1143e71', 'request_id': 'req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.984004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a59ba9e8b044beb0f0fef7e1143e71', 'request_id': 'req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:32.999244 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] The token cache is being invalidate because project 91a59ba9e8b044beb0f0fef7e1143e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:32.999532 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:33.000562 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2d3c82bd-05b6-4fce-a70c-a26aaab6871c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:33.002099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1391/2779] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:32 2022] DELETE /identity/v3/projects/91a59ba9e8b044beb0f0fef7e1143e71 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:36.332641 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:36.334205 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:36.347271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887d81-b510-4377-8d13-05e9f6ddec93 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:36.403303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:36.404185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:36.404460 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:36.404746 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] PATH_INFO: `/v3/users/22965712b7d74a5da96c182bc0b254f3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:36.405954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=22965712b7d74a5da96c182bc0b254f3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:36.408234 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:36.456860 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22965712b7d74a5da96c182bc0b254f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:36.463684 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22965712b7d74a5da96c182bc0b254f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:36.464358 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22965712b7d74a5da96c182bc0b254f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:36.465004 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22965712b7d74a5da96c182bc0b254f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:36.476969 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22965712b7d74a5da96c182bc0b254f3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:36.491466 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1389/2780] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:36 2022] DELETE /identity/v3/users/22965712b7d74a5da96c182bc0b254f3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:36.496089 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:36.496613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:36.496613 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:36.515204 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:36.516415 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:36.563128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:36.584314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1392/2781] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:36.594208 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:36.595792 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:36.616694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:36.656149 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb4521-3778-41bb-b1f8-37d94b48d46b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:36.660912 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:36.661561 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:36.661841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:36.662110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:36.672039 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:36.673499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:36.683230 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1390/2782] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:36.993854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:36.995321 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:37.009843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268aef2-1a65-488f-b8a2-c0d7ee0d6488 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:37.015837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:37.016808 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:37.017155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:37.017281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] PATH_INFO: `/v3/projects/03ed1af3e4054b3aaae4be21f781c1b7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:37.018619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ed1af3e4054b3aaae4be21f781c1b7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:37.020743 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:37.070079 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ed1af3e4054b3aaae4be21f781c1b7', 'request_id': 'req-c1631dd7-7381-4309-8554-58222d86b47a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.076208 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ed1af3e4054b3aaae4be21f781c1b7', 'request_id': 'req-c1631dd7-7381-4309-8554-58222d86b47a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.082101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ed1af3e4054b3aaae4be21f781c1b7', 'request_id': 'req-c1631dd7-7381-4309-8554-58222d86b47a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.095696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] The token cache is being invalidate because project 03ed1af3e4054b3aaae4be21f781c1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:37.095921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.096554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.098292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1393/2783] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:36 2022] DELETE /identity/v3/projects/03ed1af3e4054b3aaae4be21f781c1b7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:37.102300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:37.112098 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2aa83-c597-4c8a-bc72-a298202f47ac service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:37.185702 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:37.186601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:37.186884 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:37.187159 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] PATH_INFO: `/v3/users/10b96ed439f54be8998cc079f852d3af` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:37.188404 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b96ed439f54be8998cc079f852d3af)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:37.190559 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:37.242485 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b96ed439f54be8998cc079f852d3af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.249761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b96ed439f54be8998cc079f852d3af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.250517 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b96ed439f54be8998cc079f852d3af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.251225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b96ed439f54be8998cc079f852d3af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.265279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ef884bcd-bf8e-4048-8ebf-d4752c76570e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b96ed439f54be8998cc079f852d3af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.280371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1391/2784] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:37 2022] DELETE /identity/v3/users/10b96ed439f54be8998cc079f852d3af => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:37.579207 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:37.580895 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:37.595296 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1631dd7-7381-4309-8554-58222d86b47a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:37.655830 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:37.656627 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:37.656912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:37.657216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] PATH_INFO: `/v3/projects/b3da1d6ca36e4cbdbe5509c979d537be` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:37.658788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3da1d6ca36e4cbdbe5509c979d537be)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:37.660862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:37.709945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3da1d6ca36e4cbdbe5509c979d537be', 'request_id': 'req-c12aa125-20ba-48e0-a0b5-e48d101fb44e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.716103 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3da1d6ca36e4cbdbe5509c979d537be', 'request_id': 'req-c12aa125-20ba-48e0-a0b5-e48d101fb44e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.721858 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3da1d6ca36e4cbdbe5509c979d537be', 'request_id': 'req-c12aa125-20ba-48e0-a0b5-e48d101fb44e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.736691 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] The token cache is being invalidate because project b3da1d6ca36e4cbdbe5509c979d537be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:37.737216 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.738109 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c12aa125-20ba-48e0-a0b5-e48d101fb44e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:37.740915 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1394/2785] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:37 2022] DELETE /identity/v3/projects/b3da1d6ca36e4cbdbe5509c979d537be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:37.746080 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb512f6-d5df-4090-9589-651ced5c82e6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:37.746592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb512f6-d5df-4090-9589-651ced5c82e6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:37.746592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb512f6-d5df-4090-9589-651ced5c82e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:37.767800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6cb512f6-d5df-4090-9589-651ced5c82e6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:37.769126 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6cb512f6-d5df-4090-9589-651ced5c82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:37.803467 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:37.840115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1392/2786] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:37.848806 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b3a0-9a80-4c68-a6ab-4ef67fc67ec4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:37.849118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b3a0-9a80-4c68-a6ab-4ef67fc67ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:37.849432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b3a0-9a80-4c68-a6ab-4ef67fc67ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:37.858124 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:37.870876 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-be12b3a0-9a80-4c68-a6ab-4ef67fc67ec4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:37.872838 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-be12b3a0-9a80-4c68-a6ab-4ef67fc67ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:37.881515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1395/2787] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:37.885949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb512f6-d5df-4090-9589-651ced5c82e6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:37.896290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb512f6-d5df-4090-9589-651ced5c82e6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:37.901560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:37.902247 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:37.902530 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:37.902804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:37.903535 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:41:37.903846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:37.905537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:37.918560 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1393/2788] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:41:37.922905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b3a0-9a80-4c68-a6ab-4ef67fc67ec4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:37.933154 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b3a0-9a80-4c68-a6ab-4ef67fc67ec4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:37.939519 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:37.940236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:37.940619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:37.941026 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:37.941874 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:37.944055 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:37.973826 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1396/2789] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:37 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:37.978824 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:37.992325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173d6cc-c4ee-4f00-acb5-fcecb7cc8def admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.055727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.056412 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.056687 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.056984 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.057701 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.059636 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.082483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1394/2790] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:37 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:38.087120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.098200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a0ab8-2757-4b58-bc0b-854f117134b9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.103755 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.104422 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.104692 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.105004 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.105728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.107328 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.120070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1397/2791] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:38.124482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.135334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c4ff-b915-4124-97a8-f23940c50bf6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.141209 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269273ff-201d-4c2b-8fcd-d028b1842e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.141863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269273ff-201d-4c2b-8fcd-d028b1842e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.142144 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269273ff-201d-4c2b-8fcd-d028b1842e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.142454 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269273ff-201d-4c2b-8fcd-d028b1842e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.143191 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269273ff-201d-4c2b-8fcd-d028b1842e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.145400 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269273ff-201d-4c2b-8fcd-d028b1842e22 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.155642 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1395/2792] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:38.160073 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.170929 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48f2b7-4178-445a-893c-2aa2635867f6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.176823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.177714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.177979 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.178280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] PATH_INFO: `/v3/projects/47a4b417161e452ba1d0ed223151ac81/users/528d48c4f40040b7861326ccf45d7c32/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.194429 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a4b417161e452ba1d0ed223151ac81, user_id=528d48c4f40040b7861326ccf45d7c32, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.197094 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.214220 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1398/2793] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:38 2022] PUT /identity/v3/projects/47a4b417161e452ba1d0ed223151ac81/users/528d48c4f40040b7861326ccf45d7c32/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:38.226374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c48b8f-f1c9-4e17-b7df-832bfe1d1de9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.226655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c48b8f-f1c9-4e17-b7df-832bfe1d1de9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.226935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c48b8f-f1c9-4e17-b7df-832bfe1d1de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.254415 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-04c48b8f-f1c9-4e17-b7df-832bfe1d1de9 None None] MFA Rules not processed for user `528d48c4f40040b7861326ccf45d7c32`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:38.255634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-04c48b8f-f1c9-4e17-b7df-832bfe1d1de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:38.327707 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1396/2794] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:38.332449 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.393843 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892691-b6d0-465f-8b53-586c8a089346 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.398848 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.399513 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.399793 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.400068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.400786 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.402693 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.431052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1399/2795] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:38 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:38.437011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c48b8f-f1c9-4e17-b7df-832bfe1d1de9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.449751 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c48b8f-f1c9-4e17-b7df-832bfe1d1de9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.483981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:38.509390 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.510060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.510344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.510619 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.511303 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.513268 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.534070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1397/2796] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:38 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:38.538117 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.549272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6acfb7-293d-44ba-8143-a443805fb1ea admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.554326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.554986 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.555267 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.555538 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.556257 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.557879 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.568825 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1400/2797] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:38.573082 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.583855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1e74-5794-406e-8afb-318a17d25095 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.588599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.589527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.589852 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.590150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] PATH_INFO: `/v3/projects/ece45f7a11d2427cac94e039d0297481/users/9d874b563c3b476f85ecc09941fbe670/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.605320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece45f7a11d2427cac94e039d0297481, user_id=9d874b563c3b476f85ecc09941fbe670, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.607971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.624055 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1398/2798] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:38 2022] PUT /identity/v3/projects/ece45f7a11d2427cac94e039d0297481/users/9d874b563c3b476f85ecc09941fbe670/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:38.628317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.639898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a87d17-670f-4e9c-bc80-bd84f55bc62d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.701390 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c5140-2c92-46f6-a708-4b062a0f5f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.702074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5140-2c92-46f6-a708-4b062a0f5f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.702364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5140-2c92-46f6-a708-4b062a0f5f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.702639 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c5140-2c92-46f6-a708-4b062a0f5f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.703424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c5140-2c92-46f6-a708-4b062a0f5f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.705072 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c5140-2c92-46f6-a708-4b062a0f5f59 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.715609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1401/2799] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:38.719934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.730801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729eaca8-a32b-4433-87fb-e9e4f5805ed4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.736248 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.737197 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.737482 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.737804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] PATH_INFO: `/v3/projects/ece45f7a11d2427cac94e039d0297481/users/9d874b563c3b476f85ecc09941fbe670/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.739987 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece45f7a11d2427cac94e039d0297481, user_id=9d874b563c3b476f85ecc09941fbe670, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.742679 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.754216 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1399/2800] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:38 2022] PUT /identity/v3/projects/ece45f7a11d2427cac94e039d0297481/users/9d874b563c3b476f85ecc09941fbe670/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:38.764533 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaece7-aed6-4556-be9a-570e2bbcd22f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.764856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaece7-aed6-4556-be9a-570e2bbcd22f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.765141 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaece7-aed6-4556-be9a-570e2bbcd22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.785101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:38.793083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-56aaece7-aed6-4556-be9a-570e2bbcd22f None None] MFA Rules not processed for user `9d874b563c3b476f85ecc09941fbe670`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:38.794741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-56aaece7-aed6-4556-be9a-570e2bbcd22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:38.875198 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1402/2801] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:38.889348 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:38.891279 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:38.953151 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115364d-fcdc-4e1a-8add-43a5de4f64b0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:38.957180 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbdb5e-4c96-4da8-8cc8-1837c70b9cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:38.957818 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbdb5e-4c96-4da8-8cc8-1837c70b9cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:38.958102 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbdb5e-4c96-4da8-8cc8-1837c70b9cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:38.958378 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbdb5e-4c96-4da8-8cc8-1837c70b9cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:38.968421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbdb5e-4c96-4da8-8cc8-1837c70b9cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:38.969973 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbdb5e-4c96-4da8-8cc8-1837c70b9cc8 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:38.979898 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1400/2802] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:39.113024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaece7-aed6-4556-be9a-570e2bbcd22f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:39.179920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaece7-aed6-4556-be9a-570e2bbcd22f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:39.186469 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:39.187364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:39.187648 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:39.187924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] PATH_INFO: `/v3/users/528d48c4f40040b7861326ccf45d7c32` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:39.189325 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528d48c4f40040b7861326ccf45d7c32)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:39.191354 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:39.253083 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528d48c4f40040b7861326ccf45d7c32'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.260832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528d48c4f40040b7861326ccf45d7c32'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.261549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528d48c4f40040b7861326ccf45d7c32'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.262222 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528d48c4f40040b7861326ccf45d7c32'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.275601 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528d48c4f40040b7861326ccf45d7c32'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.289346 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1403/2803] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:39 2022] DELETE /identity/v3/users/528d48c4f40040b7861326ccf45d7c32 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:39.294275 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:39.294590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:39.294875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:39.312970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:39.314198 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:39.376311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1401/2804] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:39.386769 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:39.388464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:39.407557 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:39.449459 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb48b-0342-4179-a3fe-a38e568b4e68 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:39.453646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:39.454299 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:39.454587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:39.454866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:39.464753 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:39.466194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:39.478074 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1404/2805] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:39.760514 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:39.762033 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:39.776923 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f8f3d-096e-48f9-8a78-2cd49217aa65 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:39.782091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:39.783430 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:39.783590 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:39.783849 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] PATH_INFO: `/v3/projects/47a4b417161e452ba1d0ed223151ac81` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:39.785289 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a4b417161e452ba1d0ed223151ac81)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:39.787214 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:39.821346 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:39.838809 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a4b417161e452ba1d0ed223151ac81', 'request_id': 'req-ff91c479-62df-4273-b8f9-9711d10eab7d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.844795 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a4b417161e452ba1d0ed223151ac81', 'request_id': 'req-ff91c479-62df-4273-b8f9-9711d10eab7d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.854752 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a4b417161e452ba1d0ed223151ac81', 'request_id': 'req-ff91c479-62df-4273-b8f9-9711d10eab7d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.865875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] The token cache is being invalidate because project 47a4b417161e452ba1d0ed223151ac81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:39.866147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.866774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:39.868304 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1402/2806] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:39 2022] DELETE /identity/v3/projects/47a4b417161e452ba1d0ed223151ac81 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:39.872673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:39.882764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae268cb-8f3d-4fce-bdd5-a4282f418ce8 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:39.941667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:39.942352 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:39.942634 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:39.942907 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] PATH_INFO: `/v3/users/9d874b563c3b476f85ecc09941fbe670` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:39.944272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d874b563c3b476f85ecc09941fbe670)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:39.946309 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:39.996683 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d874b563c3b476f85ecc09941fbe670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.003371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d874b563c3b476f85ecc09941fbe670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.004105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d874b563c3b476f85ecc09941fbe670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.005050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d874b563c3b476f85ecc09941fbe670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.017800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5709457c-214f-498b-b527-671ea31c72ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d874b563c3b476f85ecc09941fbe670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.034188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1405/2807] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:39 2022] DELETE /identity/v3/users/9d874b563c3b476f85ecc09941fbe670 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:40.327509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:40.329225 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:40.343651 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91c479-62df-4273-b8f9-9711d10eab7d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:40.407309 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:40.408464 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.408903 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.409172 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] PATH_INFO: `/v3/projects/ece45f7a11d2427cac94e039d0297481` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.410501 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece45f7a11d2427cac94e039d0297481)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:40.412509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:40.461586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece45f7a11d2427cac94e039d0297481', 'request_id': 'req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.467621 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece45f7a11d2427cac94e039d0297481', 'request_id': 'req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.476613 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece45f7a11d2427cac94e039d0297481', 'request_id': 'req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.487513 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] The token cache is being invalidate because project ece45f7a11d2427cac94e039d0297481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:40.487817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.488444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3823d1f8-01c6-4a4a-afcf-4d3944c368ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:40.490200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1403/2808] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:40 2022] DELETE /identity/v3/projects/ece45f7a11d2427cac94e039d0297481 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:40.495243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e346-6106-49d7-a169-88363ea23123 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.495536 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e346-6106-49d7-a169-88363ea23123 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.495814 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e346-6106-49d7-a169-88363ea23123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.515650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1da4e346-6106-49d7-a169-88363ea23123 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:40.516893 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1da4e346-6106-49d7-a169-88363ea23123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:40.558230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:40.589988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1406/2809] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:40.597978 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68118748-ac6f-418b-a8be-fd09415441f9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.598359 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68118748-ac6f-418b-a8be-fd09415441f9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.598603 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68118748-ac6f-418b-a8be-fd09415441f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.617539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-68118748-ac6f-418b-a8be-fd09415441f9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:40.618747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-68118748-ac6f-418b-a8be-fd09415441f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:40.627328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1404/2810] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:40.631768 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e346-6106-49d7-a169-88363ea23123 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:40.641794 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da4e346-6106-49d7-a169-88363ea23123 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:40.646905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:40.647564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.647835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.648088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.648870 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:41:40.649178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:40.650775 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:40.663945 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1407/2811] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:41:40.668271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68118748-ac6f-418b-a8be-fd09415441f9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:40.678449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68118748-ac6f-418b-a8be-fd09415441f9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:40.683696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:40.684360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.684623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.684927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.685595 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:40.687527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:40.714357 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1405/2812] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:40 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:40.718673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:40.729306 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea248c5a-a2ab-4b72-9d83-b97644757a52 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:40.788815 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:40.789491 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.789779 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.790049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.790750 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:40.792643 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:40.815923 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1408/2813] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:40 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:40.820142 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:40.831009 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5433b31-5032-457a-9a01-ec26f51563ee admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:40.836271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:40.836982 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.837266 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.837538 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.838269 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:40.839881 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:40.851499 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1406/2814] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:40.855481 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:40.866277 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe1cc-0e3c-4ecf-a6c0-7b551a29d8e9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:40.871950 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221e4bc-6ba7-4918-9272-cac836a332d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:40.872619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221e4bc-6ba7-4918-9272-cac836a332d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.872936 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221e4bc-6ba7-4918-9272-cac836a332d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.873471 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221e4bc-6ba7-4918-9272-cac836a332d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.873943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221e4bc-6ba7-4918-9272-cac836a332d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:40.875555 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221e4bc-6ba7-4918-9272-cac836a332d5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:40.886785 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1409/2815] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:41:40.893556 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:40.900804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:40.905562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c445b-c048-4e00-85db-9eabcb6455b1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:40.912991 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:40.914136 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.914364 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.914646 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] PATH_INFO: `/v3/projects/510c6fb096de4a499329f5c6034b597e/users/77b668b495124f44b6929ad795a6de8a/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.931135 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=510c6fb096de4a499329f5c6034b597e, user_id=77b668b495124f44b6929ad795a6de8a, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:40.933937 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:40.949274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1407/2816] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:40 2022] PUT /identity/v3/projects/510c6fb096de4a499329f5c6034b597e/users/77b668b495124f44b6929ad795a6de8a/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:40.961183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181b26-f072-41df-8c0e-1c4a2a64e836 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:40.961470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181b26-f072-41df-8c0e-1c4a2a64e836 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:40.961747 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181b26-f072-41df-8c0e-1c4a2a64e836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:40.989579 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f9181b26-f072-41df-8c0e-1c4a2a64e836 None None] MFA Rules not processed for user `77b668b495124f44b6929ad795a6de8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:40.990819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9181b26-f072-41df-8c0e-1c4a2a64e836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:41.068043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1410/2817] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:41.072790 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.137704 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0795c-b9ba-432d-9e89-47c3e7c57f9c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.146961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.147633 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.147913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.148181 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.148908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.150845 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.180256 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1408/2818] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:41 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:41.184968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9181b26-f072-41df-8c0e-1c4a2a64e836 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.198687 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9181b26-f072-41df-8c0e-1c4a2a64e836 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.231134 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:41.259278 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.259961 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.260243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.260511 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.261253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.263162 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.283860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1411/2819] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:41 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:41:41.288400 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.299063 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7d4e5-6b57-480b-9f15-a677740e4aa8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.304383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.305084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.305363 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.305639 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.306345 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.307951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.319994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1409/2820] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:41.324492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.340621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3aee3-82c5-4694-9216-bc73aba699ed admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.349715 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f342-0ab4-4976-90fe-54350ce5683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.350397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f342-0ab4-4976-90fe-54350ce5683a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.350679 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f342-0ab4-4976-90fe-54350ce5683a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.350952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f342-0ab4-4976-90fe-54350ce5683a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.351674 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f342-0ab4-4976-90fe-54350ce5683a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.353295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f342-0ab4-4976-90fe-54350ce5683a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.364342 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1412/2821] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:41.369421 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.382855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa60694-2024-4a04-9f71-f626ef8e036e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.388592 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.389527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.389804 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.390079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] PATH_INFO: `/v3/projects/fe1955eeae524866a114b313b39537dc/users/29749b4adcad44c5b7d24405d5ec1058/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.405502 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1955eeae524866a114b313b39537dc, user_id=29749b4adcad44c5b7d24405d5ec1058, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.408534 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.423131 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1410/2822] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:41 2022] PUT /identity/v3/projects/fe1955eeae524866a114b313b39537dc/users/29749b4adcad44c5b7d24405d5ec1058/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:41.435101 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce12169-8916-408c-9bdf-f65dd8cbc82a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.435512 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce12169-8916-408c-9bdf-f65dd8cbc82a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.435867 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce12169-8916-408c-9bdf-f65dd8cbc82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.465523 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fce12169-8916-408c-9bdf-f65dd8cbc82a None None] MFA Rules not processed for user `29749b4adcad44c5b7d24405d5ec1058`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:41.466733 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fce12169-8916-408c-9bdf-f65dd8cbc82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:41.531378 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1413/2823] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:41.536966 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.607070 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b26b16-8461-4dac-8cba-4a1f86140448 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.612875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.613548 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.613831 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.614110 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.614776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.616812 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.646167 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1411/2824] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:41 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:41.651010 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce12169-8916-408c-9bdf-f65dd8cbc82a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.662407 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce12169-8916-408c-9bdf-f65dd8cbc82a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.720609 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.721253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.721539 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.721812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.722503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.724464 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.746952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1414/2825] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:41 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:41.752885 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.768179 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820457-6264-4105-9141-2e1071f7bb3b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.774543 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.775297 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.775564 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.775836 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.776549 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.778212 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.789637 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1412/2826] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:41.793817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.804230 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5f76-cc41-4242-bfb1-a3220f4fee31 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.809662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.810568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.810844 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.811110 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] PATH_INFO: `/v3/projects/6b2b096c63444001a4db00adf3439b10/users/9b81857cac54474fab6cbb56d87b20d3/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.826389 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2b096c63444001a4db00adf3439b10, user_id=9b81857cac54474fab6cbb56d87b20d3, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.829014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.848798 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1415/2827] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:41 2022] PUT /identity/v3/projects/6b2b096c63444001a4db00adf3439b10/users/9b81857cac54474fab6cbb56d87b20d3/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:41.853150 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.859778 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:41.864123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337ab4-da2c-42bb-88eb-4e6cb70b946c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.929003 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9641cd3-5a8f-4f2c-a082-0f36953ad85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.929678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641cd3-5a8f-4f2c-a082-0f36953ad85e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.929960 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641cd3-5a8f-4f2c-a082-0f36953ad85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.930237 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9641cd3-5a8f-4f2c-a082-0f36953ad85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.930979 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9641cd3-5a8f-4f2c-a082-0f36953ad85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.932602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9641cd3-5a8f-4f2c-a082-0f36953ad85e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.943276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1413/2828] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:41.948393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:41.959260 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc742cf-e066-4174-bab8-7992c60eaf80 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:41.965070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:41.965963 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.966245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.966521 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] PATH_INFO: `/v3/projects/6b2b096c63444001a4db00adf3439b10/users/9b81857cac54474fab6cbb56d87b20d3/roles/2072cf36ca344da697b097313f411f3b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:41.968619 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2b096c63444001a4db00adf3439b10, user_id=9b81857cac54474fab6cbb56d87b20d3, role_id=2072cf36ca344da697b097313f411f3b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:41.971341 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:41.973707 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:41.984024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1416/2829] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:41 2022] PUT /identity/v3/projects/6b2b096c63444001a4db00adf3439b10/users/9b81857cac54474fab6cbb56d87b20d3/roles/2072cf36ca344da697b097313f411f3b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:41.994950 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:41.995344 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:41.995688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:42.023290 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] MFA Rules not processed for user `9b81857cac54474fab6cbb56d87b20d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:42.024509 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:42.096774 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1414/2830] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:42.108363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:42.110295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:42.171987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd42136-0d29-4754-8744-35153d5ee227 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:42.176108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:42.176782 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:42.177087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:42.177363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:42.239050 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:42.240503 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:42.249805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1417/2831] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:43.761896 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:43.763481 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:43.776570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe37b99-7c49-4535-9ffa-6d41f6b09e35 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:43.780917 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:43.781558 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:43.781835 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:43.782139 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:43.841440 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:43.842947 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:43.852351 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1415/2832] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:44.447199 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:44.456621 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f208e-6623-4d9e-b19f-b69e83008d4c service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:44.460922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edf606-f4c4-41cd-95ec-d22ae17fc612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:44.461571 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edf606-f4c4-41cd-95ec-d22ae17fc612 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:44.461854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edf606-f4c4-41cd-95ec-d22ae17fc612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:44.462130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edf606-f4c4-41cd-95ec-d22ae17fc612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:44.472364 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edf606-f4c4-41cd-95ec-d22ae17fc612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:44.473832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edf606-f4c4-41cd-95ec-d22ae17fc612 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:44.484387 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1418/2833] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:48.398339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:48.427337 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:48.466518 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d37f8a-aae4-4578-8542-46d981168295 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:48.473863 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:48.475058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:48.475397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:48.475719 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] PATH_INFO: `/v3/users/77b668b495124f44b6929ad795a6de8a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:48.479062 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b668b495124f44b6929ad795a6de8a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:48.481555 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:48.535453 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b668b495124f44b6929ad795a6de8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:48.542961 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b668b495124f44b6929ad795a6de8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:48.543655 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b668b495124f44b6929ad795a6de8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:48.544274 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b668b495124f44b6929ad795a6de8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:48.557807 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b668b495124f44b6929ad795a6de8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:48.578391 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1416/2834] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:48 2022] DELETE /identity/v3/users/77b668b495124f44b6929ad795a6de8a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:48.583049 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:48.583534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:48.583650 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:48.602738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:48.604696 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:48.675229 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1419/2835] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:48.686678 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:48.688196 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:48.748586 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b711af8-5ebc-4bb9-a4b6-fb075c99818d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:48.752738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:48.753459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:48.753741 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:48.754013 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:48.763826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:48.765310 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:48.775027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1417/2836] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:41:49.064832 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:49.066409 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:49.081087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e207dc-269b-4727-8159-486d13e23de0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:49.087430 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:49.088319 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:49.088595 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:49.088885 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] PATH_INFO: `/v3/projects/510c6fb096de4a499329f5c6034b597e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:49.090189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=510c6fb096de4a499329f5c6034b597e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:49.092179 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:49.134231 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:49.149811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510c6fb096de4a499329f5c6034b597e', 'request_id': 'req-d06d6ab6-06ab-468a-b898-92651809a147'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.155892 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510c6fb096de4a499329f5c6034b597e', 'request_id': 'req-d06d6ab6-06ab-468a-b898-92651809a147'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.162070 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510c6fb096de4a499329f5c6034b597e', 'request_id': 'req-d06d6ab6-06ab-468a-b898-92651809a147'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.177163 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] The token cache is being invalidate because project 510c6fb096de4a499329f5c6034b597e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:49.177447 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.178075 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.179903 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1420/2837] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:49 2022] DELETE /identity/v3/projects/510c6fb096de4a499329f5c6034b597e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:49.184744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:49.198174 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6296ca-3e03-44cc-850a-58401408e6b4 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:49.247114 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:49.261293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:49.262182 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:49.262459 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:49.262732 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] PATH_INFO: `/v3/users/29749b4adcad44c5b7d24405d5ec1058` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:49.264000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29749b4adcad44c5b7d24405d5ec1058)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:49.265951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:49.316446 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29749b4adcad44c5b7d24405d5ec1058'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.323403 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29749b4adcad44c5b7d24405d5ec1058'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.324075 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29749b4adcad44c5b7d24405d5ec1058'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.324697 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29749b4adcad44c5b7d24405d5ec1058'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.336747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29749b4adcad44c5b7d24405d5ec1058'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.354463 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1418/2838] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:49 2022] DELETE /identity/v3/users/29749b4adcad44c5b7d24405d5ec1058 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:41:49.654363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:49.655831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:49.674926 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d6ab6-06ab-468a-b898-92651809a147 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:49.740401 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:49.741308 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:49.741682 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:49.741873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] PATH_INFO: `/v3/projects/fe1955eeae524866a114b313b39537dc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:49.743105 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1955eeae524866a114b313b39537dc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:49.745045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:49.795417 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1955eeae524866a114b313b39537dc', 'request_id': 'req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.802130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1955eeae524866a114b313b39537dc', 'request_id': 'req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.807956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1955eeae524866a114b313b39537dc', 'request_id': 'req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.820788 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] The token cache is being invalidate because project fe1955eeae524866a114b313b39537dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:49.821095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.821718 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.823281 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1421/2839] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:49 2022] DELETE /identity/v3/projects/fe1955eeae524866a114b313b39537dc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:49.827328 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:49.828828 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:49.842217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5ab8-1a4c-49e7-8250-c95446aae095 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:49.900495 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:49.901444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:49.901725 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:49.901999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] PATH_INFO: `/v3/users/9b81857cac54474fab6cbb56d87b20d3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:49.903217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b81857cac54474fab6cbb56d87b20d3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:49.905217 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:49.957078 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b81857cac54474fab6cbb56d87b20d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.964219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b81857cac54474fab6cbb56d87b20d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.964940 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b81857cac54474fab6cbb56d87b20d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.965579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b81857cac54474fab6cbb56d87b20d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.973424 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:49.980173 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cffb10d-b44e-40ea-a787-c231b1a82f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b81857cac54474fab6cbb56d87b20d3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:49.994550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1419/2840] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:41:49 2022] DELETE /identity/v3/users/9b81857cac54474fab6cbb56d87b20d3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:50.277617 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:50.279238 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:50.295416 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0aab1-b8e6-4fa3-8af5-119a8a8b3370 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:50.342500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:50.357164 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:50.358056 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.358334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.358606 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] PATH_INFO: `/v3/projects/6b2b096c63444001a4db00adf3439b10` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.359833 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2b096c63444001a4db00adf3439b10)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:50.361822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:50.409036 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2b096c63444001a4db00adf3439b10', 'request_id': 'req-720bffc0-1a0e-4841-97a8-fe32f39dff15'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:50.415189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2b096c63444001a4db00adf3439b10', 'request_id': 'req-720bffc0-1a0e-4841-97a8-fe32f39dff15'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:50.421078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2b096c63444001a4db00adf3439b10', 'request_id': 'req-720bffc0-1a0e-4841-97a8-fe32f39dff15'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:50.435155 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] The token cache is being invalidate because project 6b2b096c63444001a4db00adf3439b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:41:50.435437 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:50.436210 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-720bffc0-1a0e-4841-97a8-fe32f39dff15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:41:50.437819 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1422/2841] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:41:50 2022] DELETE /identity/v3/projects/6b2b096c63444001a4db00adf3439b10 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:50.442958 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c39c-79a3-456c-96df-005b2a90b173 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.443249 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c39c-79a3-456c-96df-005b2a90b173 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.443527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c39c-79a3-456c-96df-005b2a90b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.462097 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7bc5c39c-79a3-456c-96df-005b2a90b173 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:50.463323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7bc5c39c-79a3-456c-96df-005b2a90b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:50.522826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1420/2842] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:50.586854 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7175-c1ee-4c0c-a039-73303d556bbb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.587099 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7175-c1ee-4c0c-a039-73303d556bbb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.587405 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a7175-c1ee-4c0c-a039-73303d556bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.607800 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b20a7175-c1ee-4c0c-a039-73303d556bbb None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:50.609023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b20a7175-c1ee-4c0c-a039-73303d556bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:50.618604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1423/2843] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:50.623027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5c39c-79a3-456c-96df-005b2a90b173 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:50.633471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5c39c-79a3-456c-96df-005b2a90b173 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:50.638841 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:50.639510 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.639800 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.640079 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.640853 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:41:50.641195 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:50.642813 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:50.654915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1421/2844] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:41:50.659758 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7175-c1ee-4c0c-a039-73303d556bbb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:50.669680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a7175-c1ee-4c0c-a039-73303d556bbb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:50.674487 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:50.675131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.675412 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.675681 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.676359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:50.678270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:50.710587 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1424/2845] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:41:50 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:41:50.714758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:50.724652 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07abe85-df02-41a4-b639-59961367162d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:50.781626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:50.782634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.782914 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.783186 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.783876 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:50.785872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:50.808579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1422/2846] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:41:50 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:41:50.814037 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:50.825043 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5d693-1928-4de4-baa1-faa905753d02 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:50.830594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:50.831317 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.831690 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.831968 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.832695 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:50.834334 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:50.845783 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1425/2847] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:41:50.850030 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:50.861058 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc9e1d-3338-4c96-8741-502d8dfe46d0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:50.866200 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26dd17-2364-4d49-adac-5c32e82fe0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:50.867425 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dd17-2364-4d49-adac-5c32e82fe0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.867699 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dd17-2364-4d49-adac-5c32e82fe0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.867971 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26dd17-2364-4d49-adac-5c32e82fe0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.868694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26dd17-2364-4d49-adac-5c32e82fe0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:50.870318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26dd17-2364-4d49-adac-5c32e82fe0e4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:50.880753 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1423/2848] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:41:50.885624 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:50.895535 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11913-e175-4b8f-a471-5d496f6d3212 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:50.900946 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:50.901821 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.902097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.902371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] PATH_INFO: `/v3/projects/4ce97a7f272343cc8a7ebe7400dbeb34/users/b6e10295b9164503a1188a3f3b8b6063/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.917564 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce97a7f272343cc8a7ebe7400dbeb34, user_id=b6e10295b9164503a1188a3f3b8b6063, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:50.920194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:50.935326 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1426/2849] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:41:50 2022] PUT /identity/v3/projects/4ce97a7f272343cc8a7ebe7400dbeb34/users/b6e10295b9164503a1188a3f3b8b6063/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:41:50.946846 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c3a55-ed91-4d9a-aec5-dbede34ea1c7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:50.947146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c3a55-ed91-4d9a-aec5-dbede34ea1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:50.947414 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c3a55-ed91-4d9a-aec5-dbede34ea1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:50.973776 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-645c3a55-ed91-4d9a-aec5-dbede34ea1c7 None None] MFA Rules not processed for user `b6e10295b9164503a1188a3f3b8b6063`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:41:50.974970 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-645c3a55-ed91-4d9a-aec5-dbede34ea1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:51.015910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:41:51.043483 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1424/2850] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:41:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:41:51.058428 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:41:51.060590 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:41:51.138214 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde5b11-be1e-4024-ac86-c6188d9c7f69 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:41:51.143256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b641a5b-1ee4-4ce5-8c30-0e507a02bedc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:41:51.143905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641a5b-1ee4-4ce5-8c30-0e507a02bedc service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:41:51.144188 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641a5b-1ee4-4ce5-8c30-0e507a02bedc service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:41:51.144462 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641a5b-1ee4-4ce5-8c30-0e507a02bedc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:41:51.154182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641a5b-1ee4-4ce5-8c30-0e507a02bedc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:41:51.155594 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641a5b-1ee4-4ce5-8c30-0e507a02bedc service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:41:51.165404 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1427/2851] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:41:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:01.040570 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=9 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:01.161894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:12.015869 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c3a55-ed91-4d9a-aec5-dbede34ea1c7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:12.083413 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c3a55-ed91-4d9a-aec5-dbede34ea1c7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:12.088857 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:12.089747 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.090024 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.090295 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] PATH_INFO: `/v3/users/b6e10295b9164503a1188a3f3b8b6063` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.091575 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e10295b9164503a1188a3f3b8b6063)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:12.093554 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:12.151934 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e10295b9164503a1188a3f3b8b6063'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.161628 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e10295b9164503a1188a3f3b8b6063'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.162312 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e10295b9164503a1188a3f3b8b6063'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.162908 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e10295b9164503a1188a3f3b8b6063'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.174729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e10295b9164503a1188a3f3b8b6063'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.188634 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1425/2852] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:42:12 2022] DELETE /identity/v3/users/b6e10295b9164503a1188a3f3b8b6063 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:12.193359 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.193889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.193889 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.213790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:12.215025 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:12.279116 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1428/2853] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:12.291422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:12.293025 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:12.352522 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ab97c-ed35-4fba-a86f-a64987e00737 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:12.356654 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ced53-a13d-4f09-907f-3aec9311c785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:12.357334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ced53-a13d-4f09-907f-3aec9311c785 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.357614 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ced53-a13d-4f09-907f-3aec9311c785 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.357887 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ced53-a13d-4f09-907f-3aec9311c785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.367939 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ced53-a13d-4f09-907f-3aec9311c785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:12.369471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ced53-a13d-4f09-907f-3aec9311c785 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:12.379074 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1426/2854] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:12.683078 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:12.684598 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:12.697280 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c29c-cc86-4081-bf47-a0829ea560f6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:12.703013 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:12.705131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.705289 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.705654 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] PATH_INFO: `/v3/projects/4ce97a7f272343cc8a7ebe7400dbeb34` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.706860 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce97a7f272343cc8a7ebe7400dbeb34)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:12.708914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:12.757891 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce97a7f272343cc8a7ebe7400dbeb34', 'request_id': 'req-ce3783c8-0472-4556-90f0-b6cf3fae6345'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.764363 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce97a7f272343cc8a7ebe7400dbeb34', 'request_id': 'req-ce3783c8-0472-4556-90f0-b6cf3fae6345'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.770515 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce97a7f272343cc8a7ebe7400dbeb34', 'request_id': 'req-ce3783c8-0472-4556-90f0-b6cf3fae6345'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.785938 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] The token cache is being invalidate because project 4ce97a7f272343cc8a7ebe7400dbeb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:42:12.786190 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.786835 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ce3783c8-0472-4556-90f0-b6cf3fae6345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:42:12.788421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1429/2855] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:42:12 2022] DELETE /identity/v3/projects/4ce97a7f272343cc8a7ebe7400dbeb34 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:12.793942 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1102cef-44ff-4e02-8723-f222cb44cbc8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.794229 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1102cef-44ff-4e02-8723-f222cb44cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.794503 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1102cef-44ff-4e02-8723-f222cb44cbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.812536 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e1102cef-44ff-4e02-8723-f222cb44cbc8 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:12.813744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e1102cef-44ff-4e02-8723-f222cb44cbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:12.831178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:12.878935 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1427/2856] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:12.888243 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f0434-dc8d-46fc-8e00-a3d25c7c90aa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.888605 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f0434-dc8d-46fc-8e00-a3d25c7c90aa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.888943 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f0434-dc8d-46fc-8e00-a3d25c7c90aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.908924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b85f0434-dc8d-46fc-8e00-a3d25c7c90aa None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:12.910148 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b85f0434-dc8d-46fc-8e00-a3d25c7c90aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:12.919452 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1430/2857] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:12.923922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1102cef-44ff-4e02-8723-f222cb44cbc8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:12.934271 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1102cef-44ff-4e02-8723-f222cb44cbc8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:12.939648 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:12.940301 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.940579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.940882 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.941602 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:42:12.941909 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:12.943568 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:12.956349 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1428/2858] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:42:12.960847 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f0434-dc8d-46fc-8e00-a3d25c7c90aa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:12.970657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f0434-dc8d-46fc-8e00-a3d25c7c90aa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:12.976314 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:12.977000 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:12.977282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:12.977554 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:12.978263 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:12.980247 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.007853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1431/2859] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:42:12 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:42:13.012675 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:13.026311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d44bdc-ffaf-44f3-a7b3-a229a58f281b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:13.086439 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:13.087113 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.087397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.087670 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.088366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:13.090611 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.111355 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1429/2860] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:42:13 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:42:13.115742 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:13.126504 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df17a5-29c2-431f-b91c-7351f66f854d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:13.132152 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:13.132853 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.133142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.133413 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.134143 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:13.135827 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.147024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1432/2861] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:42:13.151130 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:13.162435 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487cf31-c511-46b9-b115-62f82c0f69cc admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:13.168635 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcbb8c-46e9-46cf-b77f-8e20984516d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:13.169323 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcbb8c-46e9-46cf-b77f-8e20984516d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.169604 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcbb8c-46e9-46cf-b77f-8e20984516d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.169868 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcbb8c-46e9-46cf-b77f-8e20984516d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.170596 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcbb8c-46e9-46cf-b77f-8e20984516d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:13.172185 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcbb8c-46e9-46cf-b77f-8e20984516d9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.182579 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1430/2862] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:42:13.186987 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:13.197665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56e371-bc50-409f-b933-03bd5467e19f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:13.204088 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:13.205005 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.205282 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.205550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] PATH_INFO: `/v3/projects/412072676d1b42c0b3c311234f249122/users/3cbcedd6b146440ca81b0a9b9d1d109c/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.222024 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412072676d1b42c0b3c311234f249122, user_id=3cbcedd6b146440ca81b0a9b9d1d109c, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:13.224685 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.242994 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1433/2863] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:42:13 2022] PUT /identity/v3/projects/412072676d1b42c0b3c311234f249122/users/3cbcedd6b146440ca81b0a9b9d1d109c/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:42:13.248184 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff320-b955-4234-a9c8-45409823dc84 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.248470 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff320-b955-4234-a9c8-45409823dc84 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.248773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff320-b955-4234-a9c8-45409823dc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.267393 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c7aff320-b955-4234-a9c8-45409823dc84 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:13.268615 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c7aff320-b955-4234-a9c8-45409823dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:13.333011 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1431/2864] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:13.343098 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:13.345045 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:13.367245 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:13.406922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff8924-d52b-4751-9aa3-3f4706d34648 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:13.411259 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:13.411914 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:13.412197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:13.412472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:13.422150 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:13.423612 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:13.433371 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1434/2865] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:14.070696 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aba6f-26fd-4c21-841e-d59cade10f77 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:14.071123 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aba6f-26fd-4c21-841e-d59cade10f77 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:14.071253 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aba6f-26fd-4c21-841e-d59cade10f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:14.099422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-247aba6f-26fd-4c21-841e-d59cade10f77 None None] MFA Rules not processed for user `3cbcedd6b146440ca81b0a9b9d1d109c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:14.100688 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-247aba6f-26fd-4c21-841e-d59cade10f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:14.119797 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:14.171091 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1432/2866] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:42:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:14.183559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:14.185228 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:14.249898 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bb793-b950-4982-ba23-83f87b8967bf service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:14.253608 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:14.254270 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:14.254550 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:14.254822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:14.263932 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:14.265393 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:14.274380 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1435/2867] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:15.639153 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:15.639758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:15.639758 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:15.658915 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] MFA Rules not processed for user `3cbcedd6b146440ca81b0a9b9d1d109c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:15.660116 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:15.667722 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1433/2868] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:42:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:15.706059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:15.707580 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:15.775863 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d32c95-cc22-4b93-b9ed-b79f89f99128 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:15.780912 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91b91c561e944aa5924e3e08bbdf63fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:15.781552 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:15.781862 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:15.782135 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:15.784421 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:15.859631 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:15.861009 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:15.872522 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1436/2869] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:16.444856 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:16.446336 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:16.459547 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba553-2d0c-4428-897f-159c8f4903c0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:16.463686 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf99f6-00cb-49e0-9baa-0a0f565ed682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:16.464409 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf99f6-00cb-49e0-9baa-0a0f565ed682 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:16.464789 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf99f6-00cb-49e0-9baa-0a0f565ed682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:16.465219 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf99f6-00cb-49e0-9baa-0a0f565ed682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:16.467334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3bcf99f6-00cb-49e0-9baa-0a0f565ed682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:16.481981 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf99f6-00cb-49e0-9baa-0a0f565ed682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:16.483406 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf99f6-00cb-49e0-9baa-0a0f565ed682 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:16.495787 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1434/2870] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:23.971147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:23.981178 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e9eb5-5686-49fb-9261-f9307c6ffd3a service glance] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:23.985206 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:23.985851 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:23.986131 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:23.986402 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:23.988356 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:23.994549 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:23.999837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:24.001370 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:24.009981 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1437/2871] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:26.489492 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=28 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:34.006290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:41.091311 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e053-b614-48f8-9a85-e677f8ce4bab None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.091875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e053-b614-48f8-9a85-e677f8ce4bab None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.091875 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e053-b614-48f8-9a85-e677f8ce4bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.111959 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0d62e053-b614-48f8-9a85-e677f8ce4bab None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:41.113300 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0d62e053-b614-48f8-9a85-e677f8ce4bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:41.122910 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1435/2872] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:41.147922 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:41.149873 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:41.168189 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a102ada-56dd-4a7c-8721-60dc312c4e9e service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:41.174921 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:41.175568 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:41.175839 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:41.176084 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:41.184637 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:41.186223 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:41.196463 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1438/2873] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:44.182002 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076bd29-2f04-44dc-a0eb-230d0ea5be9b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.182773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076bd29-2f04-44dc-a0eb-230d0ea5be9b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.182773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076bd29-2f04-44dc-a0eb-230d0ea5be9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.206582 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e076bd29-2f04-44dc-a0eb-230d0ea5be9b None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:44.207798 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e076bd29-2f04-44dc-a0eb-230d0ea5be9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:44.221610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1436/2874] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:44.240962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:44.242638 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:44.259790 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e3d25-3d71-4b8e-9f7d-974b2ea5c7cd service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:44.266880 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:44.267547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:44.268180 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:44.268455 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:44.277662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:44.279240 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:44.289253 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1439/2875] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:47.440674 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b6bd-c3ff-4265-9c0b-bde6ab2152b4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.441318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b6bd-c3ff-4265-9c0b-bde6ab2152b4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.441318 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5b6bd-c3ff-4265-9c0b-bde6ab2152b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.468115 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f8d5b6bd-c3ff-4265-9c0b-bde6ab2152b4 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:47.469562 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f8d5b6bd-c3ff-4265-9c0b-bde6ab2152b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:47.479601 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1437/2876] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:47.494518 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:47.505901 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325fc20-6009-4220-ba4f-58d30c7bb963 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:47.512076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:47.512734 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:47.513014 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:47.513276 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:47.521433 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:47.523012 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:47.532436 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1440/2877] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:50.536657 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1db11-5214-401d-90b1-bcbb1e3c3642 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.537235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1db11-5214-401d-90b1-bcbb1e3c3642 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.537235 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1db11-5214-401d-90b1-bcbb1e3c3642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.557240 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-46b1db11-5214-401d-90b1-bcbb1e3c3642 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:50.558444 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-46b1db11-5214-401d-90b1-bcbb1e3c3642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:50.567712 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1438/2878] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:50.593197 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:50.605822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbeb367-e76c-4a73-bd21-f1507db1cbbf service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:50.612988 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:50.613632 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:50.613916 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:50.614183 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:50.623252 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:50.624866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:50.634662 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1441/2879] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:53.749339 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0304fa5-9e3b-477c-8d41-66eb0f9b97b9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.749862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0304fa5-9e3b-477c-8d41-66eb0f9b97b9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.749862 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0304fa5-9e3b-477c-8d41-66eb0f9b97b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.769989 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c0304fa5-9e3b-477c-8d41-66eb0f9b97b9 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:53.771189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c0304fa5-9e3b-477c-8d41-66eb0f9b97b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:53.780832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1439/2880] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:42:53.798058 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:53.810432 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbde03b-601a-4360-a353-14e1d01ea061 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:53.816510 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:53.817256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:53.817537 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:53.817803 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:53.826738 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:53.828295 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:53.838042 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1442/2881] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:42:56.938422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1643b5-b659-4393-8fc7-017e4732a40e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:56.939124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1643b5-b659-4393-8fc7-017e4732a40e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:56.939124 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1643b5-b659-4393-8fc7-017e4732a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:56.968929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ac1643b5-b659-4393-8fc7-017e4732a40e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:42:56.970158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ac1643b5-b659-4393-8fc7-017e4732a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:42:56.980293 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1440/2882] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:42:56.998822 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:42:57.011130 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34a2cf-c326-43b0-b424-152171b7bfa6 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:42:57.017856 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271df3-7929-4b6c-82cf-153983e1f7f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:42:57.018500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271df3-7929-4b6c-82cf-153983e1f7f8 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:42:57.018784 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271df3-7929-4b6c-82cf-153983e1f7f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:42:57.019059 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271df3-7929-4b6c-82cf-153983e1f7f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:42:57.027996 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271df3-7929-4b6c-82cf-153983e1f7f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:42:57.029736 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271df3-7929-4b6c-82cf-153983e1f7f8 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:42:57.039811 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1443/2883] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:06.592418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1643b5-b659-4393-8fc7-017e4732a40e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:06.600913 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=19 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:06.608354 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1643b5-b659-4393-8fc7-017e4732a40e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:06.614262 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:06.614968 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:06.615270 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:06.615545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:06.617729 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:06.631649 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:06.633278 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:06.644178 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1441/2884] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:07.035298 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=36 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:11.160657 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f16c8-c602-4341-ad82-533ef9f6e201 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.161330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f16c8-c602-4341-ad82-533ef9f6e201 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.161330 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f16c8-c602-4341-ad82-533ef9f6e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.180128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-906f16c8-c602-4341-ad82-533ef9f6e201 None None] MFA Rules not processed for user `3cbcedd6b146440ca81b0a9b9d1d109c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:11.181396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-906f16c8-c602-4341-ad82-533ef9f6e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:11.190817 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1444/2885] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:43:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:43:11.762647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:11.764218 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:11.837665 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174afb6a-ab14-4066-b97f-4890304ab5bd service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:11.842794 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae4dc9-7a50-4e96-82fa-edbb4cfc45ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:11.843443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4dc9-7a50-4e96-82fa-edbb4cfc45ff service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:11.843725 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4dc9-7a50-4e96-82fa-edbb4cfc45ff service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:11.843994 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae4dc9-7a50-4e96-82fa-edbb4cfc45ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:11.845855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f9ae4dc9-7a50-4e96-82fa-edbb4cfc45ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:11.857585 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4dc9-7a50-4e96-82fa-edbb4cfc45ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:11.859152 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae4dc9-7a50-4e96-82fa-edbb4cfc45ff service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:11.868980 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1442/2886] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:20.193030 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f16c8-c602-4341-ad82-533ef9f6e201 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:20.207642 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f16c8-c602-4341-ad82-533ef9f6e201 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:20.213167 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:20.213828 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:20.214114 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:20.214384 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:20.216358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:20.229501 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:20.231236 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:20.242770 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1445/2887] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:21.864999 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=37 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:24.216537 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bed0-6bd6-438b-aa08-08748c51ba6c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:24.217242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bed0-6bd6-438b-aa08-08748c51ba6c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:24.217242 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9bed0-6bd6-438b-aa08-08748c51ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:24.235682 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ceb9bed0-6bd6-438b-aa08-08748c51ba6c None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:24.236949 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ceb9bed0-6bd6-438b-aa08-08748c51ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:24.246559 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1443/2888] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:43:24.263837 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:24.276516 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd8bed-6c55-42e2-b120-a88903f6b25c service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:24.284969 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:24.285620 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:24.285905 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:24.286182 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:24.295457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:24.297068 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:24.307395 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1446/2889] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:27.613093 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69c93-4f8e-4b64-87b4-b176d7459c16 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.613775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69c93-4f8e-4b64-87b4-b176d7459c16 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.613775 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69c93-4f8e-4b64-87b4-b176d7459c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.633431 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-18a69c93-4f8e-4b64-87b4-b176d7459c16 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:27.634647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-18a69c93-4f8e-4b64-87b4-b176d7459c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:27.644527 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1444/2890] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:43:27.660051 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:27.671547 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d189a-676a-414f-83ae-bac352cd703c service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:27.677956 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:27.678589 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:27.678875 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:27.679169 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:27.687497 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:27.689146 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:27.698592 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1447/2891] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:30.608325 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e452-a287-433c-b513-696a8660790f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.608837 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e452-a287-433c-b513-696a8660790f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.608945 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893e452-a287-433c-b513-696a8660790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.629146 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e893e452-a287-433c-b513-696a8660790f None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:30.630360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e893e452-a287-433c-b513-696a8660790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:30.638727 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1445/2892] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:43:30.657667 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:30.670924 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345735e4-91aa-48a4-81db-63efcf9a1a61 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:30.678200 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:30.678831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:30.679111 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:30.679386 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:30.687991 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:30.689600 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:30.699383 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1448/2893] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:33.816189 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787db42-b872-4103-b53f-a3a6129bfb2d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.816694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787db42-b872-4103-b53f-a3a6129bfb2d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.816694 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787db42-b872-4103-b53f-a3a6129bfb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.836632 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7787db42-b872-4103-b53f-a3a6129bfb2d None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:33.837872 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7787db42-b872-4103-b53f-a3a6129bfb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:33.847983 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1446/2894] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:43:33.867087 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:33.878939 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d315b72-c6f4-42a1-a03d-0d6920b839a9 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:33.885500 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:33.886142 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:33.886425 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:33.886728 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:33.896492 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:33.898095 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:33.909397 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1449/2895] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:37.059922 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3216d-3896-4355-8860-b8f995f04412 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.060507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3216d-3896-4355-8860-b8f995f04412 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.060507 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3216d-3896-4355-8860-b8f995f04412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.079793 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cbf3216d-3896-4355-8860-b8f995f04412 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:43:37.081016 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cbf3216d-3896-4355-8860-b8f995f04412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:43:37.089593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1447/2896] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 11:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:43:37.131310 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:43:37.138572 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=34 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:37.149118 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5812c-250c-43d8-8dfc-4c91ee3f3775 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:43:37.155160 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb2aadd5a1204d35a8325b3d56d20b03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:43:37.155792 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:43:37.156076 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:43:37.156351 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:43:37.165563 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:43:37.167128 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:43:37.176688 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1450/2897] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:43:47.074158 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=15 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:43:47.172604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:05.252541 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3216d-3896-4355-8860-b8f995f04412 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.262894 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3216d-3896-4355-8860-b8f995f04412 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.268929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.270000 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.270276 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.270550 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] PATH_INFO: `/v3/users/3cbcedd6b146440ca81b0a9b9d1d109c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.271761 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbcedd6b146440ca81b0a9b9d1d109c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.273801 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.323720 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbcedd6b146440ca81b0a9b9d1d109c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.331504 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbcedd6b146440ca81b0a9b9d1d109c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.332588 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbcedd6b146440ca81b0a9b9d1d109c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.333567 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbcedd6b146440ca81b0a9b9d1d109c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.351157 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf78ee25-45ea-4c70-a6df-ae373d28fcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbcedd6b146440ca81b0a9b9d1d109c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.365422 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1448/2898] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:44:05 2022] DELETE /identity/v3/users/3cbcedd6b146440ca81b0a9b9d1d109c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:05.544749 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.555379 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102c401-ca11-432b-b5a3-7d6a7d196768 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.614611 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.615517 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.615823 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.616097 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] PATH_INFO: `/v3/projects/412072676d1b42c0b3c311234f249122` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.617435 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=412072676d1b42c0b3c311234f249122)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.619377 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.670829 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412072676d1b42c0b3c311234f249122', 'request_id': 'req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.677672 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412072676d1b42c0b3c311234f249122', 'request_id': 'req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.685894 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412072676d1b42c0b3c311234f249122', 'request_id': 'req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.704812 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] The token cache is being invalidate because project 412072676d1b42c0b3c311234f249122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:44:05.705120 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.705866 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7d939b1b-e72a-4f57-9f88-5f78fd5bfff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:05.707559 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1451/2899] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:44:05 2022] DELETE /identity/v3/projects/412072676d1b42c0b3c311234f249122 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:05.712664 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cafe-31b4-4f0a-9413-36468020ad0e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.712976 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cafe-31b4-4f0a-9413-36468020ad0e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.713277 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3cafe-31b4-4f0a-9413-36468020ad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.733693 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cac3cafe-31b4-4f0a-9413-36468020ad0e None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:05.735610 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cac3cafe-31b4-4f0a-9413-36468020ad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:05.797222 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1449/2900] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:44:05.805665 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ecf72-7c85-44c9-8ce8-694c0cf26943 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.805952 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ecf72-7c85-44c9-8ce8-694c0cf26943 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.806225 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ecf72-7c85-44c9-8ce8-694c0cf26943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.825157 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0b1ecf72-7c85-44c9-8ce8-694c0cf26943 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:05.826358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0b1ecf72-7c85-44c9-8ce8-694c0cf26943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:05.835468 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1452/2901] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:44:05.839928 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cafe-31b4-4f0a-9413-36468020ad0e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.850930 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3cafe-31b4-4f0a-9413-36468020ad0e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.856471 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.857320 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.857626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.857906 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.858683 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:44:05.859027 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.861292 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.874599 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1450/2902] 10.222.0.66 () {58 vars in 1152 bytes} [Thu Jun 23 11:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:44:05.879477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ecf72-7c85-44c9-8ce8-694c0cf26943 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.888962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ecf72-7c85-44c9-8ce8-694c0cf26943 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:05.894764 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:05.895420 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:05.895702 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:05.895976 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:05.896680 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:05.898615 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:05.934003 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1453/2903] 10.222.0.66 () {60 vars in 1152 bytes} [Thu Jun 23 11:44:05 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:05.938533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:05.948622 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba61db-4d08-488a-b9a4-d4e2e95fefa5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.008703 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.009317 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.009593 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.009861 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.010539 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.012437 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.019383 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:06.035929 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1451/2904] 10.222.0.66 () {60 vars in 1143 bytes} [Thu Jun 23 11:44:05 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:44:06.039534 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.050343 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07d107-0292-427c-ba57-440b05e9065c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.055248 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.055920 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.056194 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.056470 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.057264 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.058906 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.070122 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1454/2905] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:44:06.074280 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.084773 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86298c54-51f5-4edd-8f45-5a2e02d163f8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.089449 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04773872-49d0-4fde-bcfb-a9de6e908546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.090084 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773872-49d0-4fde-bcfb-a9de6e908546 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.090369 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773872-49d0-4fde-bcfb-a9de6e908546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.090647 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04773872-49d0-4fde-bcfb-a9de6e908546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.091397 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773872-49d0-4fde-bcfb-a9de6e908546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.093044 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04773872-49d0-4fde-bcfb-a9de6e908546 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.103360 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1452/2906] 10.222.0.66 () {58 vars in 1121 bytes} [Thu Jun 23 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:44:06.108065 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.119472 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fffa9-0bbb-4b9c-9c09-2c5a6ba95da0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.125358 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.126292 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.126604 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.126881 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] PATH_INFO: `/v3/projects/f5319e45f9e14b3d94f1d02a242585ed/users/44b462e66ca94b6a9981f94cdc82ceff/roles/f99f7537ebc7412399a1a7c5f6add8c1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.142147 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5319e45f9e14b3d94f1d02a242585ed, user_id=44b462e66ca94b6a9981f94cdc82ceff, role_id=f99f7537ebc7412399a1a7c5f6add8c1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.144805 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.161254 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1455/2907] 10.222.0.66 () {60 vars in 1482 bytes} [Thu Jun 23 11:44:06 2022] PUT /identity/v3/projects/f5319e45f9e14b3d94f1d02a242585ed/users/44b462e66ca94b6a9981f94cdc82ceff/roles/f99f7537ebc7412399a1a7c5f6add8c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:44:06.176168 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9963bfa-8553-4a10-9274-c1806316fe79 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.176457 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9963bfa-8553-4a10-9274-c1806316fe79 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.176772 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9963bfa-8553-4a10-9274-c1806316fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.203832 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b9963bfa-8553-4a10-9274-c1806316fe79 None None] MFA Rules not processed for user `44b462e66ca94b6a9981f94cdc82ceff`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:06.205066 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b9963bfa-8553-4a10-9274-c1806316fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:06.271064 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1453/2908] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:44:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:44:06.284457 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:06.286424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:06.330962 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:06.361424 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06504-707c-4583-ada4-da71fb6dfe54 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:06.365527 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbafbc-1781-4e05-a6cc-abcddbe86b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab171a27a8d043869eddc76d2befe09c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:06.366186 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbafbc-1781-4e05-a6cc-abcddbe86b77 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:06.366465 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbafbc-1781-4e05-a6cc-abcddbe86b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:06.366744 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbafbc-1781-4e05-a6cc-abcddbe86b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:06.375272 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbafbc-1781-4e05-a6cc-abcddbe86b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:06.376709 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbafbc-1781-4e05-a6cc-abcddbe86b77 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:06.385725 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1456/2909] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:44:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:44:16.267826 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.381751 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=14 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.541487 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9963bfa-8553-4a10-9274-c1806316fe79 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.639951 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9963bfa-8553-4a10-9274-c1806316fe79 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.644927 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.645817 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.646099 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.646371 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] PATH_INFO: `/v3/users/44b462e66ca94b6a9981f94cdc82ceff` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.647580 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b462e66ca94b6a9981f94cdc82ceff)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.649545 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.700738 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b462e66ca94b6a9981f94cdc82ceff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:16.707366 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b462e66ca94b6a9981f94cdc82ceff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:16.708125 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b462e66ca94b6a9981f94cdc82ceff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:16.708744 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b462e66ca94b6a9981f94cdc82ceff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:16.722719 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b462e66ca94b6a9981f94cdc82ceff'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:16.737954 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1454/2910] 10.222.0.66 () {58 vars in 1223 bytes} [Thu Jun 23 11:44:16 2022] DELETE /identity/v3/users/44b462e66ca94b6a9981f94cdc82ceff => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:16.742542 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.742831 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.743108 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.770852 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] MFA Rules not processed for user `91e4179db7ac4303a76052708306002a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:44:16.772060 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:16.831652 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1457/2911] 10.222.0.66 () {58 vars in 957 bytes} [Thu Jun 23 11:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:44:16.842043 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:16.844418 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:16.913147 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:16.952525 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b2abe-95cb-43e1-af5b-c9254a60326a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:16.957193 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795571c4c2cc4f969ce487c0ec6dfbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:16.957855 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:16.958132 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:16.958493 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:16.968374 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:16.969907 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:16.979533 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1455/2912] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:44:17.515673 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:17.517201 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:17.534290 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258767-479f-42b9-89fd-ea003cb6ee84 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:17.540196 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e4179db7ac4303a76052708306002a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7142c8080614c18a4273bc9286ea762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:17.541137 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:17.541477 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:17.541646 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] PATH_INFO: `/v3/projects/f5319e45f9e14b3d94f1d02a242585ed` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:17.542919 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5319e45f9e14b3d94f1d02a242585ed)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:17.544931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:17.593052 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5319e45f9e14b3d94f1d02a242585ed', 'request_id': 'req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:17.599256 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5319e45f9e14b3d94f1d02a242585ed', 'request_id': 'req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:17.604931 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5319e45f9e14b3d94f1d02a242585ed', 'request_id': 'req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:17.618741 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] The token cache is being invalidate because project f5319e45f9e14b3d94f1d02a242585ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:44:17.619023 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:17.619714 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-41d52ee5-7a93-44cf-aff3-2d1ed50b27d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:44:17.621396 dv-cinder-820994-2-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1458/2913] 10.222.0.66 () {58 vars in 1232 bytes} [Thu Jun 23 11:44:17 2022] DELETE /identity/v3/projects/f5319e45f9e14b3d94f1d02a242585ed => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:44:26.975356 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=17 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:27.615446 dv-cinder-820994-2-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:57.280677 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:44:57.282443 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:57.386626 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b16d92-5c46-46a4-84ae-9f75d381828d service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:44:57.450681 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe6d56-fb6e-4d7f-b830-8b8ae4127f0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5411be02252b4749be7e1a06d7ddcb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c1ca6fca9e44c999e68ff7917b11b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:44:57.451334 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6d56-fb6e-4d7f-b830-8b8ae4127f0c service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:44:57.451623 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6d56-fb6e-4d7f-b830-8b8ae4127f0c service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:44:57.451864 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe6d56-fb6e-4d7f-b830-8b8ae4127f0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:44:57.454023 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d6fe6d56-fb6e-4d7f-b830-8b8ae4127f0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:44:57.466060 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe6d56-fb6e-4d7f-b830-8b8ae4127f0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:44:57.467658 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe6d56-fb6e-4d7f-b830-8b8ae4127f0c service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:44:57.477993 dv-cinder-820994-2-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1456/2914] 10.222.0.66 () {60 vars in 1365 bytes} [Thu Jun 23 11:44:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:45:07.473779 dv-cinder-820994-2-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=67 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}